Knowledge benchmark
SimpleQA leaderboard
Measuring Short-Form Factuality in Large Language Models. Every model the catalog carries a published SimpleQA value for, ranked by that value.
A benchmark that evaluates the ability of language models to answer short, fact-seeking questions accurately. Focuses on factual correctness rather than reasoning complexity.
SimpleQA ranking
3 models with a published SimpleQA value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.
| Rank | Model | Provider | Short-form Q&A |
|---|---|---|---|
| 1 |  DeepSeek V4 Pro 0813 | DeepSeek | 57.9 |
| 2 | DeepSeek V4 Flash 0731 | DeepSeek | 34.1 |
| 3 |  MAI-Thinking-1 | Microsoft | 31 |
Evidence key: Observed
Rows are ordered by the value Measuring short-form factuality in large language models published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.