Zyphra/dclm-dedup download history

Zyphra/dclm-dedup is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 5,077 times (400 in the last 7 days), and 339,731 times in total. It ranks #5,639 among datasets by monthly downloads.

DCLM-Deduped DCLM is a recently released high quality dataset that uses model-based quality filtering to filter a large subset of common-crawl for similarity to OpenHermes and other instruction-tuning datasets. For reference see the DCLM paper. The original authors of DCLM did not release

Open Zyphra/dclm-dedup on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.