gpjt/fineweb-edu-gpt2-tokens download history

gpjt/fineweb-edu-gpt2-tokens is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 53 times (21 in the last 7 days), and 419 times in total. It ranks #177,952 among datasets by monthly downloads.

FineWeb-Edu GPT-2 Tokens This is all of the 10B sample of FineWeb-Edu, split into 99% training data, 1% validation data, each converted to a single uint16 tensor of GPT-2 tokens. The text for each record in the original dataset was tokenized using tiktoken, then they were all concatenated

Models trained on fineweb-edu-gpt2-tokens

1 models list it as training data.

• gpjt/jax-with-mha-bias-fineweb-edu 325 downloads in 30 days

Open gpjt/fineweb-edu-gpt2-tokens on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.