CMU-FLAME/FLAME-MoE-Traces download history

CMU-FLAME/FLAME-MoE-Traces is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 664 times (101 in the last 7 days), and 14,632 times in total. It ranks #26,431 among datasets by monthly downloads.

FLAME-MoE Routing Traces Routing traces captured during pretraining of FLAME-MoE Mixture-of-Experts language models. For each token processed by the model, these traces record which experts the router selected (top-k expert IDs) and the corresponding gating probabilities (router softmax s

Open CMU-FLAME/FLAME-MoE-Traces on Hugging Face