anisoleai/fineweb-tokenized download history

anisoleai/fineweb-tokenized is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 44,106 times (2,396 in the last 7 days), and 8,919,024 times in total. It ranks #578 among datasets by monthly downloads.

FineWeb Tokenized > 4 trillion tokens of the pre-tokenized data the 🌐 web has to offer What is it? This is a pre-tokenized version of the HuggingFaceFW/fineweb dataset (currently in-progress, tokenization of the ~15 trillion tokens corpus is ongoing). The data i

Spaces using fineweb-tokenized

• Model Pulse 8 likes

Open anisoleai/fineweb-tokenized on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.