datajuicer/redpajama-cc-2020-05-refined-by-data-juicer download history

datajuicer/redpajama-cc-2020-05-refined-by-data-juicer is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 14 times (6 in the last 7 days), and 647 times in total. It ranks #471,210 among datasets by monthly downloads.

RedPajama -- CommonCrawl-2020-05 (refined by Data-Juicer) A refined version of CommonCrawl-2020-05 dataset in RedPajama by Data-Juicer. Removing some "bad" samples from the original dataset to make it higher-quality. This dataset is usually used to pretrain a Large Language Model. Notice:

Models trained on redpajama-cc-2020-05-refined-by-data-juicer

5 models list it as training data.

Open datajuicer/redpajama-cc-2020-05-refined-by-data-juicer on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.