Hoglet-33/3.33BT-Pre-Training-Mix-Three-Of-Three download history

Hoglet-33/3.33BT-Pre-Training-Mix-Three-Of-Three is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 54 times (7 in the last 7 days), and 255 times in total. It ranks #175,582 among datasets by monthly downloads.

This is mix three of three in a ten billion token pre-training cirriculum. Dataset Rows Token share FineWeb-Edu 871,429 25.01% DCLM 498,667 20.03% Cosmopedia-V2 752,500 14.99% Code 1,400,000 19.99% Math 382,000 19.99% About 3.336 billion tokens.Mix one and two can be found he

Open Hoglet-33/3.33BT-Pre-Training-Mix-Three-Of-Three on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.