Coding benchmark
SWE Multimodal leaderboard
SWE-bench Multimodal. Every model the catalog carries a published SWE Multimodal value for, ranked by that value.
A multimodal variant of SWE-bench that adds visual context such as screenshots and design mockups to software engineering issue descriptions.
SWE Multimodal ranking
4 models with a published SWE Multimodal value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.
| Rank | Model | Provider | Code patch generation with visual context |
|---|---|---|---|
| 1 | Anthropic | 59.4 | |
| 2 | Anthropic | 54.7 | |
| 3 | Anthropic | 38.4 | |
| 4 | Anthropic | 28.1 |
Evidence key: Observed
Rows are ordered by the value SWE-bench Multimodal published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.