CategoryMathematics
MeasureFinal-answer accuracy
Tasks57 recent research-mathematics problems
DifficultyResearch mathematics
Final-answer research mathematics problems drawn from recent arXiv papers, including problems based on resolved or refuted conjectures.
ArXivMath Aug. 2026 (no tools) ranking
2 models with a published ArXivMath Aug. 2026 (no tools) value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.
Models ranked by their published ArXivMath August 2026 without tools value| Rank | Model | Provider | Final-answer accuracy |
|---|
| 1 |  Claude Opus 5.5 | Anthropic | 91.2 |
| 2 | Claude Sonnet 5.5 | Anthropic | 86.8 |
Evidence key: Observed
Rows are ordered by the value Claude Opus 5.5 System Card published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
About ArXivMath Aug. 2026 (no tools)
What the benchmark measures and how its value is published, from the source’s own record.
What is ArXivMath Aug. 2026 (no tools)?
ArXivMath Aug. 2026 (no tools) (ArXivMath August 2026 without tools) is a mathematics benchmark published by Claude Opus 5.5 System Card. Final-answer research mathematics problems drawn from recent arXiv papers, including problems based on resolved or refuted conjectures. Its evaluation set is described by the source as 57 recent research-mathematics problems. The source rates its difficulty as research mathematics.
How is ArXivMath Aug. 2026 (no tools) scored?
Each model's result is published by Claude Opus 5.5 System Card as final-answer accuracy. ModelScale prints that value to 1 decimal place, exactly as published, and never converts or rescales it. This page ranks the 2 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.
ModelScale