# SWE Multilingual leaderboard

Coding benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/leaderboards/benchmarks/coding-swe-multilingual

Every model the catalog carries a published SWE Multilingual value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Coding |
| Measure | Repository task completion |
| Tasks | Multilingual software-engineering tasks |
| Difficulty | Professional software engineering |
| Published by | [MiniMax M2.7: Early Echoes of Self-Evolution](https://www.minimax.io/news/minimax-m27-en) |

A multilingual software-engineering benchmark for real-world code issue resolution across multiple programming languages.

## SWE Multilingual ranking

60 models with a published SWE Multilingual value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Repository task completion | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [Claude Fable 5.2](https://modelscale.dev/models/claude-fable-5-2) | Anthropic | 96.6 | Observed 2026-11-21 · source benchlm:models |
| 2 | [Claude Opus 5.5](https://modelscale.dev/models/claude-opus-5-5) | Anthropic | 93.9 | Observed 2026-11-21 · source benchlm:models |
| 3 | [Claude Sonnet 5.5](https://modelscale.dev/models/claude-sonnet-5-5) | Anthropic | 90.3 | Observed 2026-11-21 · source benchlm:models |
| 4 | [Claude Opus 5](https://modelscale.dev/models/claude-opus-5) | Anthropic | 89.5 | Observed 2026-11-21 · source benchlm:models |
| 5 | [Claude Fable 5.1](https://modelscale.dev/models/claude-fable-5-1) | Anthropic | 89.1 | Observed 2026-11-21 · source benchlm:models |
| 6 | [Ling 3.1 Flash](https://modelscale.dev/models/ling-3-1-flash) | InclusionAI | 88.5 | Observed 2026-11-21 · source benchlm:models |
| 7 | [Claude Opus 4.8](https://modelscale.dev/models/claude-opus-4-8) | Anthropic | 84.4 | Observed 2026-11-21 · source benchlm:models |
| 8 | [Hy4 preview](https://modelscale.dev/models/hy4-preview) | Tencent | 82.9 | Observed 2026-11-21 · source benchlm:models |
| 9 | [Inkling 2 Small](https://modelscale.dev/models/inkling-2-small) | Thinking Machines Lab | 81.2 | Observed 2026-11-21 · source benchlm:models |
| 10 | [Qwen3.8-Flash-Next](https://modelscale.dev/models/qwen3-8-flash-next) | Alibaba | 81 | Observed 2026-11-21 · source benchlm:models |
| 11 | [Qwen3.8-Omni-Flash](https://modelscale.dev/models/qwen3-8-omni-flash) | Alibaba | 80.5 | Observed 2026-11-21 · source benchlm:models |
| 12 | [Composer 2.5](https://modelscale.dev/models/composer-2-5) | Cursor | 79.8 | Observed 2026-11-21 · source benchlm:models |
| 13 | [Ornith-1.5-397B](https://modelscale.dev/models/ornith-1-5-397b) | Ornith AI | 79.6 | Observed 2026-11-21 · source benchlm:models |
| 14 | [Ornith-1.0-397B](https://modelscale.dev/models/ornith-1-0-397b) | DeepReinforce AI | 78.9 | Observed 2026-11-21 · source benchlm:models |
| 15 | [Laguna S 2.1](https://modelscale.dev/models/laguna-s-2-1) | Poolside | 78.5 | Observed 2026-11-21 · source benchlm:models |
| 16 | [Beam 1.0 501B-A23B](https://modelscale.dev/models/reflection-beam) | Reflection AI | 78.3 | Observed 2026-11-21 · source benchlm:models |
| 16 | [Claude Sonnet 5](https://modelscale.dev/models/claude-sonnet-5) | Anthropic | 78.3 | Observed 2026-11-21 · source benchlm:models |
| 16 | [Qwen3.7 Max](https://modelscale.dev/models/qwen3-7-max) | Alibaba | 78.3 | Observed 2026-11-21 · source benchlm:models |
| 19 | [Beam 1.0 501B-A23B FP8](https://modelscale.dev/models/reflection-beam-fp8) | Reflection AI | 78.1 | Observed 2026-11-21 · source benchlm:models |
| 20 | [Grok 4.5](https://modelscale.dev/models/grok-4-5) | xAI | 78 | Observed 2026-11-21 · source benchlm:models |
| 21 | [SWE-1.7](https://modelscale.dev/models/swe-1-7) | Cognition | 77.8 | Observed 2026-11-21 · source benchlm:models |
| 22 | [Beam 1.0 501B-A23B NVFP4](https://modelscale.dev/models/reflection-beam-nvfp4) | Reflection AI | 77.5 | Observed 2026-11-21 · source benchlm:models |
| 22 | [Claude Opus 4.5](https://modelscale.dev/models/claude-opus-4-5) | Anthropic | 77.5 | Observed 2026-11-21 · source benchlm:models |
| 24 | [Kimi K2.6](https://modelscale.dev/models/kimi-2-6) | Moonshot AI | 76.7 | Observed 2026-11-21 · source benchlm:models |
| 25 | [MiniMax M2.7](https://modelscale.dev/models/minimax-m2-7) | MiniMax | 76.5 | Observed 2026-11-21 · source benchlm:models |
| 26 | [DeepSeek V4 Pro](https://modelscale.dev/models/deepseek-v4-pro) | DeepSeek | 76.2 | Observed 2026-11-21 · source benchlm:models |
| 26 | [DeepSeek V4 Pro 0813](https://modelscale.dev/models/deepseek-v4-pro-max) | DeepSeek | 76.2 | Last good 2026-11-18 · source benchlm:models |
| 28 | [Qwen3.7 Plus](https://modelscale.dev/models/qwen3-7-plus) | Alibaba | 75.8 | Observed 2026-11-21 · source benchlm:models |
| 29 | [dots3-note Preview](https://modelscale.dev/models/dots3-note-preview) | Dots Studio | 75.7 | Observed 2026-11-21 · source benchlm:models |
| 30 | [Qwen3.6 Plus](https://modelscale.dev/models/qwen3-6-plus) | Alibaba | 73.8 | Observed 2026-11-21 · source benchlm:models |
| 31 | [Composer 2](https://modelscale.dev/models/composer-2) | Cursor | 73.7 | Observed 2026-11-21 · source benchlm:models |
| 31 | [Inkling 2 Mini](https://modelscale.dev/models/inkling-2-mini) | Thinking Machines Lab | 73.7 | Observed 2026-11-21 · source benchlm:models |
| 33 | [DeepSeek V4 Flash 0731](https://modelscale.dev/models/deepseek-v4-flash-max) | DeepSeek | 73.3 | Observed 2026-11-21 · source benchlm:models |
| 33 | [GLM-5](https://modelscale.dev/models/glm-5) | Z.AI | 73.3 | Observed 2026-11-21 · source benchlm:models |
| 35 | [Kimi K2.5](https://modelscale.dev/models/kimi-k2-5) | Moonshot AI | 73 | Observed 2026-11-21 · source benchlm:models |
| 36 | [Sage-A1.5](https://modelscale.dev/models/sage-a1-5) | InternScience | 72.7 | Observed 2026-11-21 · source benchlm:models |
| 37 | [Ling 3.0 Flash](https://modelscale.dev/models/ling-3-0-flash) | InclusionAI | 72.4 | Observed 2026-11-21 · source benchlm:models |
| 38 | [MiMo-V2-Flash](https://modelscale.dev/models/mimo-v2-flash) | Xiaomi | 71.7 | Observed 2026-11-21 · source benchlm:models |
| 39 | [Ornith-1.5-35B-A3B](https://modelscale.dev/models/ornith-1-5-35b-a3b) | Ornith AI | 71.4 | Observed 2026-11-21 · source benchlm:models |
| 40 | [Qwen3.6-27B](https://modelscale.dev/models/qwen3-6-27b) | Alibaba | 71.3 | Observed 2026-11-21 · source benchlm:models |
| 41 | [Ornith-1.0-35B](https://modelscale.dev/models/ornith-1-0-35b) | DeepReinforce AI | 69.3 | Observed 2026-11-21 · source benchlm:models |
| 41 | [Qwen3.5 397B](https://modelscale.dev/models/qwen3-5-397b) | Alibaba | 69.3 | Observed 2026-11-21 · source benchlm:models |
| 43 | [Nemotron 3.5 Super VL 120B A12B](https://modelscale.dev/models/nemotron-3-5-super-vl-120b-a12b) | NVIDIA | 67.72 | Observed 2026-11-21 · source benchlm:models |
| 44 | [Nemotron 3 Ultra](https://modelscale.dev/models/nemotron-3-ultra-500b) | NVIDIA | 67.7 | Observed 2026-11-21 · source benchlm:models |
| 45 | [Qwen3.6-35B-A3B](https://modelscale.dev/models/qwen3-6-35b-a3b) | Alibaba | 67.2 | Observed 2026-11-21 · source benchlm:models |
| 46 | [Nemotron 3.5 Super VL 120B A12B NVFP4](https://modelscale.dev/models/nemotron-3-5-super-vl-120b-a12b-nvfp4) | NVIDIA | 67 | Observed 2026-11-21 · source benchlm:models |
| 47 | [Spark-X2.6-4B](https://modelscale.dev/models/spark-x2-6-4b) | SparkLLM | 64.7 | Observed 2026-11-21 · source benchlm:models |
| 48 | [Laguna M.1](https://modelscale.dev/models/laguna-m-1) | Poolside | 63.1 | Observed 2026-11-21 · source benchlm:models |
| 48 | [Laguna XS 2.1](https://modelscale.dev/models/laguna-xs-2-1) | Poolside | 63.1 | Observed 2026-11-21 · source benchlm:models |
| 50 | [LongCat-Flash-Lite-Sparse](https://modelscale.dev/models/longcat-flash-lite-sparse) | Meituan | 59.33 | Observed 2026-11-21 · source benchlm:models |
| 51 | [Laguna XS.2](https://modelscale.dev/models/laguna-xs-2) | Poolside | 57.7 | Observed 2026-11-21 · source benchlm:models |
| 52 | [Qwen3-Coder 480B-A35B](https://modelscale.dev/models/qwen3-coder-480b-a35b) | Alibaba | 54.7 | Observed 2026-11-21 · source benchlm:models |
| 53 | [Ornith-1.5-9B](https://modelscale.dev/models/ornith-1-5-9b) | Ornith AI | 54.4 | Observed 2026-11-21 · source benchlm:models |
| 54 | [Ornith-1.0-9B](https://modelscale.dev/models/ornith-1-0-9b) | DeepReinforce AI | 52 | Observed 2026-11-21 · source benchlm:models |
| 55 | [Kimi K2](https://modelscale.dev/models/kimi-k2) | Moonshot AI | 47.3 | Observed 2026-11-21 · source benchlm:models |
| 56 | [Granite 4.2 30B](https://modelscale.dev/models/granite-4-2-30b) | IBM | 41.89 | Observed 2026-11-21 · source benchlm:models |
| 57 | [Nemotron 3.5 Lightning 30B A3B NVFP4](https://modelscale.dev/models/nemotron-3-5-lightning-30b-a3b-nvfp4) | NVIDIA | 36.47 | Observed 2026-11-21 · source benchlm:models |
| 58 | [Granite 4.2 8B](https://modelscale.dev/models/granite-4-2-8b) | IBM | 30.78 | Observed 2026-11-21 · source benchlm:models |
| 59 | [LLaDA2.2-flash](https://modelscale.dev/models/llada2-2-flash) | InclusionAI | 25 | Observed 2026-11-21 · source benchlm:models |
| 60 | [LFM3-1.7B](https://modelscale.dev/models/lfm3-1-7b) | LiquidAI | 23 | Observed 2026-11-21 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
