Reasoning benchmark
GPQA Diamond leaderboard
Every model the catalog carries a published GPQA Diamond value for, ranked by that value.
CategoryReasoning
MeasureMultiple choice questions
TasksExpert-level science questions
DifficultyGraduate-level scientific reasoning
The hardest subset of GPQA featuring the most challenging graduate-level science questions. Sometimes reported separately from the standard GPQA benchmark.
No model in the catalog has a published GPQA Diamond score.
The benchmark is defined by GPQA: A Graduate-Level Google-Proof Q&A Benchmark, but the catalog carries no value for it yet. An absent value is shown as absent here rather than as a zero.