HuggingFaceFW/finepdfs_50BT-dclm_30BT-fineweb_edu_20BT download history

HuggingFaceFW/finepdfs_50BT-dclm_30BT-fineweb_edu_20BT is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 2,672 times (300 in the last 7 days), and 90,834 times in total. It ranks #9,139 among datasets by monthly downloads.

FinePDFs 50BT + DCLM 30BT + FineWeb-Edu 20BT A ~100 billion token pretraining mixture combining three high-quality English data sources in a 50-30-20 ratio. Part of the Smol-Data collection — tried and tested mixes for strong pretraining. Inspired by optimal dataset mixing. Da

Open HuggingFaceFW/finepdfs_50BT-dclm_30BT-fineweb_edu_20BT on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.