gpjt/fineweb-gpt2-tokens download history

gpjt/fineweb-gpt2-tokens is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 112 times (49 in the last 7 days), and 457 times in total. It ranks #105,037 among datasets by monthly downloads.

FineWeb GPT-2 Tokens This is all of the 10B sample of FineWeb, split into 99% training data, 1% validation data, each converted to a single uint16 tensor of GPT-2 tokens. The text for each record in the original dataset was tokenized using tiktoken, then they were all concatenated togethe

Models trained on fineweb-gpt2-tokens

44 models list it as training data.

Open gpjt/fineweb-gpt2-tokens on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.