Skip to main content
ModelScale

Coding benchmark

SWE-bench Verified* leaderboard

SWE-bench Verified (mini-swe-agent-v2). Every model the catalog carries a published SWE-bench Verified* value for, ranked by that value.

CategoryCoding
MeasureAgent scaffold benchmark
TasksRepository task completion
DifficultyProfessional software engineering

A display-only SWE-bench Verified reference from Arcee AI's Trinity-Large-Thinking comparison chart.

SWE-bench Verified* ranking

5 models with a published SWE-bench Verified* value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

Models ranked by their published SWE-bench Verified (mini-swe-agent-v2) value
RankModelProviderAgent scaffold benchmark
1Claude Opus 4.6Anthropic75.6
2MiniMax M2.7MiniMax75.4
3GLM-5Z.AI72.8
4Kimi K2.5Moonshot AI70.8
5Trinity-Large-ThinkingArcee AI63.2

Evidence key: Observed

Rows are ordered by the value Trinity-Large-Thinking: Scaling an Open Source Frontier Agent published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.

All leaderboards · Coding capability leaderboard