Skip to main content
ModelScale

Coding benchmark

Multi-SWE Bench leaderboard

Every model the catalog carries a published Multi-SWE Bench value for, ranked by that value.

CategoryCoding
MeasureRepository task completion
TasksMulti-language repo tasks
DifficultyProfessional software engineering

A multi-language software-engineering benchmark that measures repository-level bug fixing and implementation across more than one programming ecosystem.

Multi-SWE Bench ranking

1 model with a published Multi-SWE Bench value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

Models ranked by their published Multi-SWE Bench value
RankModelProviderRepository task completion
1MiniMax M2.7MiniMax52.7

Evidence key: Observed

Rows are ordered by the value MiniMax M2.7: Early Echoes of Self-Evolution published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.

All leaderboards · Coding capability leaderboard