external benchmark
MMMU leaderboard
Vals MMMU. Every model the catalog carries a published MMMU value for, ranked by that value.
Categoryexternal
MeasureAccuracy score
TasksMultimodal academic task suite
DifficultyMultimodal college-level reasoning
Published byMMMU
Multimodal Multi-task Benchmark
No model in the catalog has a published MMMU score.
The benchmark is defined by MMMU, but the catalog carries no value for it yet. An absent value is shown as absent here rather than as a zero.