external benchmark

GPQA Diamond (Mercor) leaderboard

GPQA Diamond — Mercor evaluation. Every model the catalog carries a published GPQA Diamond (Mercor) value for, ranked by that value.

Categoryexternal

MeasurePass@1

Tasks198 source-reported tasks

DifficultySource-specific evaluation

Published byGPQA Diamond evaluation results

Graduate-level science multiple-choice questions. This table shows Mercor-run configurations for reference and is excluded from model rankings.

No model in the catalog has a published GPQA Diamond (Mercor) score.

The benchmark is defined by GPQA Diamond evaluation results, but the catalog carries no value for it yet. An absent value is shown as absent here rather than as a zero.

About GPQA Diamond (Mercor)

What the benchmark measures and how its value is published, from the source’s own record.

What is GPQA Diamond (Mercor)?

GPQA Diamond (Mercor) (GPQA Diamond — Mercor evaluation) is an external benchmark published by GPQA Diamond evaluation results. Graduate-level science multiple-choice questions. This table shows Mercor-run configurations for reference and is excluded from model rankings. Its evaluation set is described by the source as 198 source-reported tasks. The source rates its difficulty as source-specific evaluation.

How is GPQA Diamond (Mercor) scored?

Each model's result is published by GPQA Diamond evaluation results as pass@1. ModelScale prints that value to 2 decimal places, exactly as published, and never converts or rescales it. This page ranks the 0 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.

All leaderboards

Explore models

Top 1-5

Top 6-10

Featured

Capabilities

Benchmarks

Compare

Featured model comparisons

Featured provider comparisons

Articles