Categoryexternal
MeasureAccuracy (%)
Tasks10-option multiple-choice questions across 14 subjects; task version 12
Kaggle's run of MMLU-Pro, the ten-option, reasoning-heavy successor to MMLU, kept apart from provider, Vals, Artificial Analysis, and Arcee rows.
No model in the catalog has a published MMLU-Pro (Kaggle) score.The benchmark is defined by MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark, but the catalog carries no value for it yet. An absent value is shown as absent here rather than as a zero.
About MMLU-Pro (Kaggle)
What the benchmark measures and how its value is published, from the source’s own record.
What is MMLU-Pro (Kaggle)?
MMLU-Pro (Kaggle) (MMLU-Pro (Kaggle benchmark v1)) is an external benchmark published by MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark. Kaggle's run of MMLU-Pro, the ten-option, reasoning-heavy successor to MMLU, kept apart from provider, Vals, Artificial Analysis, and Arcee rows. Its evaluation set is described by the source as 10-option multiple-choice questions across 14 subjects; task version 12.
How is MMLU-Pro (Kaggle) scored?
Each model's result is published by MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark as accuracy (%). ModelScale prints that value to 1 decimal place, exactly as published, and never converts or rescales it. This page ranks the 0 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.
ModelScale