AverageMetaheuristicsEnjoyer/fineweb-edu-100BT-gpt2-bin download history

AverageMetaheuristicsEnjoyer/fineweb-edu-100BT-gpt2-bin is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 20 times (10 in the last 7 days), and 108 times in total. It ranks #374,093 among datasets by monthly downloads.

fineweb-edu 100BT — GPT-2 pre-tokenized (.bin) Pre-tokenized HuggingFaceFW/fineweb-edu :: sample/100BT for LLM pretraining without on-the-fly tokenization or HF streaming (flat uint16 token ids, nanoGPT layout). Tokenizer: gpt2 (tiktoken == HF AutoTokenizer('gpt2'), ids identical) Fo

Open AverageMetaheuristicsEnjoyer/fineweb-edu-100BT-gpt2-bin on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.