jerryyan/dclm-pool-400m-1x-student-cleaned-rescued download history

jerryyan/dclm-pool-400m-1x-student-cleaned-rescued is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 975 times (40 in the last 7 days), and 975 times in total. It ranks #19,691 among datasets by monthly downloads.

DCLM 400M-1x, cleaned by a small model Pre-training corpora built from the DCLM dclm-pool-400m-1x pool (a 10% shard sample). Boilerplate is stripped and low-value pages are dropped; what is published here is the result, already tokenized with EleutherAI/gpt-neox-20b and ready to feed

Open jerryyan/dclm-pool-400m-1x-student-cleaned-rescued on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.