chengjunyan1/smollm-12.5-corpus download history

chengjunyan1/smollm-12.5-corpus is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 1,414 times (177 in the last 7 days), and 35,048 times in total. It ranks #14,884 among datasets by monthly downloads.

SmolLM-1/8-Corpus Around 1/8 upper-quality subset of SmolLM Corpus for training Chinchilla-optimal GPT-2 scale (sub 1.5B) models, which is a good scale for verifying a model architecture under the scaling laws. Firstly filtered samples with int_score >=4 from FineWeb-edu-dedup, then k

Open chengjunyan1/smollm-12.5-corpus on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.