marin-community/grug-moe-mix-swarm download history

marin-community/grug-moe-mix-swarm is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 709 times (61 in the last 7 days), and 2,403 times in total. It ranks #25,266 among datasets by monthly downloads.

Grug-MoE Data-Mix Experiments The default config contains the original 840-run Fisher-DSP swarm. The harrier_18t75_d768 config contains the Harrier experiments described below. Fisher-DSP swarm (default) 840 MoE pretraining runs from the Grug-MoE Fisher-DSP data-mixing

Open marin-community/grug-moe-mix-swarm on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.