alexandermorgan/fineweb10B-superbpe50304-gpt2split download history

alexandermorgan/fineweb10B-superbpe50304-gpt2split is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 313 times (313 in the last 7 days), and 313 times in total. It ranks #47,497 among datasets by monthly downloads.

FineWeb 10BT, tokenized with a two-phase 50,304-token SuperBPE vocabulary (GPT-2 split pattern) All of HuggingFaceFW/fineweb sample-10BT, pre-tokenized in the binary shard format used by modded-nanogpt, with a custom SuperBPE vocabulary trained with BatchBPE (v2) on the same corpus. T

Open alexandermorgan/fineweb10B-superbpe50304-gpt2split on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.