SlayerLab/minimal-en-corpus-2.5b download history
SlayerLab/minimal-en-corpus-2.5b is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 168 times (33 in the last 7 days), and 497 times in total. It ranks #102,012 among datasets by monthly downloads.
Minimal EN Corpus 2.5B An English-language pretraining corpus prepared for experiments with a roughly 125M-parameter GPT-2 model based on karpathy/nanoGPT. The name refers to the approximately 2.5B-token mixture selected before final BPE tokenization. With the included 12,288-token BP
Open SlayerLab/minimal-en-corpus-2.5b on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.