Salesforce/fineweb_deduplicated download history

Salesforce/fineweb_deduplicated is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 592 times (121 in the last 7 days), and 118,631 times in total. It ranks #28,916 among datasets by monthly downloads.

TL;DR Fineweb is a popular and high quality open dataset. This dataset is a deduplicated version of Fineweb - removing rows with duplicate text, collecting counts. Motivation Fineweb is an open text dataset intended for training language models. It's one of the highest quality

Open Salesforce/fineweb_deduplicated on Hugging Face