MMLU (Kaggle) leaderboard

MMLU (Kaggle) (MMLU (Kaggle benchmark v1)) is an external benchmark published by Measuring Massive Multitask Language Understanding. Kaggle's run of the original 57-subject MMLU, separate from provider-reported MMLU rows. Its evaluation set is described by the source as four-option multiple-choice questions across 57 subjects; task version 7.

Each model's result is published by Measuring Massive Multitask Language Understanding as accuracy (%). ModelScale prints that value to 1 decimal place, exactly as published, and never converts or rescales it. This page ranks the 0 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.