SlayerLab/minimal-en-corpus-5b download history
SlayerLab/minimal-en-corpus-5b is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 2,578 times (127 in the last 7 days), and 2,766 times in total. It ranks #9,368 among datasets by monthly downloads.
Minimal EN Corpus 5B An English-language pretraining corpus prepared for controlled experiments with approximately 125M-parameter GPT-2 models based on karpathy/nanoGPT. The name refers to the approximately 5B-token mixture selected before final BPE tokenization. With the included 12,
Models trained on minimal-en-corpus-5b
8 models list it as training data.
- SlayerLab/pollock-mini-lm-125m 1.1K downloads in 30 days
- Maggio33/GoLLeM-v5-64M-Muon-v1 106 downloads in 30 days
- Maggio33/GoLLeM-v5-128M 59 downloads in 30 days
- Maggio33/GoLLeM-v5-128M-Muon-v1 59 downloads in 30 days
- Maggio33/GoLLeM-v5-64M 58 downloads in 30 days
- Maggio33/GoLLeM-v5-32M 56 downloads in 30 days
- Maggio33/GoLLeM-v5-16M 51 downloads in 30 days
- SlayerLab/gollem-v5-ckpts 0 downloads in 30 days