sam-paech/mmlu-pro-nomath download history

sam-paech/mmlu-pro-nomath is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 145 times (25 in the last 7 days), and 3,555 times in total. It ranks #113,891 among datasets by monthly downloads.

MMLU-Pro-NoMath MMLU-Pro-NoMath and MMLU-Pro-NoMath-Sml are subsets of MMLU-Pro with questions requiring multi-step calculation removed (43% of the original test set). We used claude-3.5-sonnet as the classifier. Questions were capped to an upper length limit to make logprobs evals fa

Open sam-paech/mmlu-pro-nomath on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.