Skip to main content
ModelScale

Reasoning benchmark

MRCR v2 256K-512K leaderboard

OpenAI MRCR v2 8-needle 256K-512K. Every model the catalog carries a published MRCR v2 256K-512K value for, ranked by that value.

CategoryReasoning
MeasureMean sequence-matcher ratio
Tasks100 eight-needle retrieval examples
DifficultyVery long-context retrieval

MRCR v2 slice focused on retrieval across 256K-512K-token contexts.

MRCR v2 256K-512K ranking

2 models with a published MRCR v2 256K-512K value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

Models ranked by their published OpenAI MRCR v2 8-needle 256K-512K value
RankModelProviderMean sequence-matcher ratio
1GPT-6 AstraOpenAI100.0
2Muse Spark 1.3Meta98.5

Evidence key: Observed

Rows are ordered by the value Muse Spark 1.3 Evaluation Methodology published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.

All leaderboards · Reasoning capability leaderboard