alexkstern/fineweb-nanochatbpe-100M download history

alexkstern/fineweb-nanochatbpe-100M is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 1,381 times (18 in the last 7 days), and 4,074 times in total. It ranks #15,157 among datasets by monthly downloads.

fineweb-nanochatbpe-100M FineWeb-Edu (from karpathy/fineweb-edu-100b-shuffle), pre-tokenized with the nanochatbpe tokenizer (vocab 65,536) and packaged as flat uint16 token-id .bin files for fast memmap training. This is a 100-million-token slice for data-constrained experiments. The

Open alexkstern/fineweb-nanochatbpe-100M on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.