sam-paech/mmlu-pro-nomath-sml download history
sam-paech/mmlu-pro-nomath-sml is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 112 times (29 in the last 7 days), and 7,533 times in total. It ranks #138,484 among datasets by monthly downloads.
MMLU-Pro-NoMath MMLU-Pro-NoMath and MMLU-Pro-NoMath-Sml are subsets of MMLU-Pro with questions requiring multi-step calculation removed (43% of the original test set). We used claude-3.5-sonnet as the classifier. Questions were capped to an upper length limit to make logprobs evals fa
Open sam-paech/mmlu-pro-nomath-sml on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.