Knowledge benchmark
CMMLU leaderboard
Chinese Massive Multitask Language Understanding. Every model the catalog carries a published CMMLU value for, ranked by that value.
CategoryKnowledge
MeasureExact match
TasksChinese academic QA
DifficultyBroad Chinese knowledge
Published byDeepSeek-V4 Technical Report
A Chinese multitask academic benchmark reported in DeepSeek-V4 base-model evaluations.
CMMLU ranking
1 model with a published CMMLU value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.
| Rank | Model | Provider | Exact match |
|---|---|---|---|
| 1 |  LongCat-Flash-Lite-Sparse | Meituan | 84.3 |
Evidence key: Observed
Rows are ordered by the value DeepSeek-V4 Technical Report published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.