Multilingual benchmark
SWE Multilingual leaderboard
SWE-bench Multilingual. Every model the catalog carries a published SWE Multilingual value for, ranked by that value.
A multilingual extension of SWE-bench covering 300 problems across 9 programming languages, testing code generation and bug fixing beyond Python.
SWE Multilingual ranking
1 model with a published SWE Multilingual value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.
| Rank | Model | Provider | Multi-language code patch generation |
|---|---|---|---|
| 1 | Anthropic | 92.2 |
Evidence key: Observed
Rows are ordered by the value SWE-bench Multilingual published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.