gaotang/loopmoe-fineweb-edu-100bt-mcore download history

gaotang/loopmoe-fineweb-edu-100bt-mcore is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 245 times (49 in the last 7 days), and 417 times in total. It ranks #57,495 among datasets by monthly downloads.

LoopMoE FineWeb-Edu 100BT (Megatron indexed) Release status: complete This is the exact pretokenized FineWeb-Edu 100BT corpus prepared for the reviewed LoopMoE M1 Dense/Loop/Dual and Fast-Slow experiment contracts. This release does not define the M2--M5 train schedules. It contains 6

Open gaotang/loopmoe-fineweb-edu-100bt-mcore on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.