Hoglet-33/3.33BT-Pre-Training-Mix-Two-Of-Three download history

Hoglet-33/3.33BT-Pre-Training-Mix-Two-Of-Three is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 41 times (8 in the last 7 days), and 101 times in total. It ranks #214,983 among datasets by monthly downloads.

This is mix two of three in a ten billion token pre-training cirriculum. Dataset Rows Token share Cosmopedia-V2 1,755,833 34.97% FineWeb-Edu 1,220,000 35.01% DCLM 374,000 15.02% Math 191,000 9.99% Code 350,000 5.00% About 3.336 billion tokens.Mix one and three can be found he

Open Hoglet-33/3.33BT-Pre-Training-Mix-Two-Of-Three on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.