KristianS7/prepacked-fineweb-edu-llama2-32K-T2048 download history

KristianS7/prepacked-fineweb-edu-llama2-32K-T2048 is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 1,613 times (356 in the last 7 days), and 7,276 times in total. It ranks #13,479 among datasets by monthly downloads.

prepacked-fineweb-edu-llama2-32K-T2048 Pre-tokenized and BOS-aligned best-fit packed version of FineWeb-Edu for training with looped nanochat. Tokenized with the Llama 2 tokenizer (32,000 base vocab + 8 special tokens = 32,008). Stats Train split

Open KristianS7/prepacked-fineweb-edu-llama2-32K-T2048 on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.