Hoglet-33/3.33BT-Pre-Training-Mix-One-Of-Three download history

Hoglet-33/3.33BT-Pre-Training-Mix-One-Of-Three is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 78 times (32 in the last 7 days), and 303 times in total. It ranks #135,785 among datasets by monthly downloads.

This is mix one of three in a ten billion token pre-training cirriculum Dataset Rows Token share FineWeb-Edu 1,568,571 44.91% DCLM 1,001,522 40.13% Cosmopedia-V2 501,667 9.97% Code 350,000 4.98% Math 0 0% About 3.34 billion tokens.Mix two and three can be found here: Hoglet-3

Open Hoglet-33/3.33BT-Pre-Training-Mix-One-Of-Three on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.