HuggingFaceFW/finepdfs_edu_50BT-dclm_30BT-fineweb_edu_20BT download history

HuggingFaceFW/finepdfs_edu_50BT-dclm_30BT-fineweb_edu_20BT is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 2,582 times (690 in the last 7 days), and 92,578 times in total. It ranks #9,357 among datasets by monthly downloads.

FinePDFs-Edu 50BT + DCLM 30BT + FineWeb-Edu 20BT A ~100 billion token pretraining mixture combining three high-quality English data sources in a 50-30-20 ratio, using the educational subset of FinePDFs. Part of the Smol-Data collection — tried and tested mixes for strong pretraining. Insp

Open HuggingFaceFW/finepdfs_edu_50BT-dclm_30BT-fineweb_edu_20BT on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.