skymizer/fineweb-edu-dedup-45B download history

skymizer/fineweb-edu-dedup-45B is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 761 times (60 in the last 7 days), and 21,853 times in total. It ranks #23,839 among datasets by monthly downloads.

Fineweb-edu-dedup 45B This dataset was filtered from HuggingFaceTB/smollm-corpus. We selected the fineweb-edu and further filtered with score > 3.0 to make the dataset with higher quality; there are 45B GPT2 tokens in this dataset. Acknowledgement We appreciate the efforts fro

Open skymizer/fineweb-edu-dedup-45B on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.