Zengying/OLMoE-mix-0924 download history
Zengying/OLMoE-mix-0924 is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 581 times (131 in the last 7 days), and 11,568 times in total. It ranks #29,383 among datasets by monthly downloads.
OLMoE Mix (September 2024) The following data mix was used to train OLMoE-1B-7B, a Mixture-of-Experts LLM with 1B active and 7B total parameters released in September 2024. The base version of OLMoE-1B-7B can be found at this page, the SFT of OLMoE-1B-7B is available here, and a versio