datajuicer/redpajama-arxiv-refined-by-data-juicer download history

datajuicer/redpajama-arxiv-refined-by-data-juicer is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 25 times (6 in the last 7 days), and 956 times in total. It ranks #316,899 among datasets by monthly downloads.

RedPajama -- ArXiv (refined by Data-Juicer) A refined version of ArXiv dataset in RedPajama by Data-Juicer. Removing some "bad" samples from the original dataset to make it higher-quality. This dataset is usually used to pretrain a Large Language Model. Notice: Here is a small subset for

Models trained on redpajama-arxiv-refined-by-data-juicer

5 models list it as training data.

Open datajuicer/redpajama-arxiv-refined-by-data-juicer on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.