Skip to main content
ModelScale

Multilingual benchmark

SWE Multilingual leaderboard

SWE-bench Multilingual. Every model the catalog carries a published SWE Multilingual value for, ranked by that value.

CategoryMultilingual
MeasureMulti-language code patch generation
Tasks300 problems across 9 languages
DifficultyProfessional multilingual software engineering

A multilingual extension of SWE-bench covering 300 problems across 9 programming languages, testing code generation and bug fixing beyond Python.

SWE Multilingual ranking

1 model with a published SWE Multilingual value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

Models ranked by their published SWE-bench Multilingual value
RankModelProviderMulti-language code patch generation
1Claude Mythos 5Anthropic92.2

Evidence key: Observed

Rows are ordered by the value SWE-bench Multilingual published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.

All leaderboards