Skip to main content
ModelScale

Coding benchmark

SWE Multimodal leaderboard

SWE-bench Multimodal. Every model the catalog carries a published SWE Multimodal value for, ranked by that value.

CategoryCoding
MeasureCode patch generation with visual context
TasksMultimodal software engineering tasks
DifficultyFrontier multimodal coding

A multimodal variant of SWE-bench that adds visual context such as screenshots and design mockups to software engineering issue descriptions.

SWE Multimodal ranking

4 models with a published SWE Multimodal value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

Models ranked by their published SWE-bench Multimodal value
RankModelProviderCode patch generation with visual context
1Claude Opus 5Anthropic59.4
2Claude Fable 5.1Anthropic54.7
3Claude Opus 4.8Anthropic38.4
4Claude Sonnet 5Anthropic28.1

Evidence key: Observed

Rows are ordered by the value SWE-bench Multimodal published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.

All leaderboards · Coding capability leaderboard