moca-embed/dclm_20b download history

moca-embed/dclm_20b is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 286 times (29 in the last 7 days), and 9,706 times in total. It ranks #50,999 among datasets by monthly downloads.

DCLM used in MoCa Pre-training 🏠 Homepage | 💻 Code | 🤖 MoCa-Qwen25VL-7B | 🤖 MoCa-Qwen25VL-3B | 📚 Datasets | 📄 Paper Introduction This is a text pre-training dataset used in the modality-aware continual pre-training of MoCa models. It is adapted from DCLM and randomly downsa

Models trained on dclm_20b

1 models list it as training data.

Open moca-embed/dclm_20b on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.