minhnguyent546/Fineweb-Edu-10BT download history

minhnguyent546/Fineweb-Edu-10BT is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 488 times (43 in the last 7 days), and 2,245 times in total. It ranks #33,776 among datasets by monthly downloads.

Dataset Summary This is the tokenized Fineweb-Edu (10BT subset) using SmolLM2-135M tokenzier. Data is divided into shards (.npy files) for easier to load with PyTorch IterableDataset. Each .npy file can be loaded with numpy.load('file_name.npy'). Split # Documents # Shards # Tokens

Open minhnguyent546/Fineweb-Edu-10BT on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.