karpathy/fineweb-edu-100B-gpt2-token-shards download history

karpathy/fineweb-edu-100B-gpt2-token-shards is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 4,362 times (925 in the last 7 days), and 41,937 times in total. It ranks #6,339 among datasets by monthly downloads.

FineWeb Edu 100B dataset tokenized with GPT-2 tokenizer using the code in llm.c repo.

Models trained on fineweb-edu-100B-gpt2-token-shards

2 models list it as training data.

Open karpathy/fineweb-edu-100B-gpt2-token-shards on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.