EleutherAI/deep-ignorance-pretraining-mix download history

EleutherAI/deep-ignorance-pretraining-mix is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 352 times (92 in the last 7 days), and 21,101 times in total. It ranks #43,385 among datasets by monthly downloads.

Deep Ignorance Model Suite We explore an intuitive yet understudied question: Can we prevent LLMs from learning unsafe technical capabilities (such as CBRN) by filtering out enough of the relevant pretraining data before we begin training a model? Research into this question resulted in t

Models trained on deep-ignorance-pretraining-mix

22 models list it as training data.

Open EleutherAI/deep-ignorance-pretraining-mix on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.