Skip to main content
ModelScale

Coding benchmark

Terminal-Bench 2.1 leaderboard

Terminal-Bench 2.1 (provider run). Every model the catalog carries a published Terminal-Bench 2.1 value for, ranked by that value.

CategoryCoding
MeasureInteractive task success rate
TasksTerminal-based software-agent tasks
DifficultyProfessional software engineering

A provider-run Terminal-Bench 2.1 result stored separately from the repository's Terminal-Bench 2.0 lane.

Terminal-Bench 2.1 ranking

33 models with a published Terminal-Bench 2.1 value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

Models ranked by their published Terminal-Bench 2.1 (provider run) value
RankModelProviderInteractive task success rate
1SWE-2Cognition92.8
2DeepSeek V4.1 FlashDeepSeek90.6
3Gemini 3.8 FlashGoogle89.4
4Muse Spark 1.3Meta88.8
5GLM-5.3Z.AI88.2
6DeepSeek V4 Pro 0813DeepSeek87.9
7Qwen3.8 MaxAlibaba86.6
8OAOrnith-1.5-397BOrnith AI86.1
9Gemini 3.7 FlashGoogle85.8
10Hy4 previewTencent85.4
11GLM-5.3-FlashZ.AI84.3
12Muse Spark 1.2Meta82.9
13DeepSeek V4 Flash 0731DeepSeek82.7
14Atria Dawn PreviewShanghai Artificial Intelligence Laboratory78.3
15DSdots3-note PreviewDots Studio75.1
16Qwen3.8-27BAlibaba73.0
17Seed 2.1 ProByteDance71.0
18APApodex 1.1Apodex70.8
19MCQuasar 438BMultiverse Computing69.3
20OAOrnith-1.5-35B-A3BOrnith AI67.8
21Seed 2.1 TurboByteDance67.6
22PAPokee-Isaac 28BPokee AI65.1
23MAI-Code-1.1-FlashMicrosoft62.9
24Ling 3.0 FlashInclusionAI57.0
24Solar Pro 4Upstage57.0
26PMTernary Bonsai 2 27BPrism ML52.8
27Muse Glimmer 30BMeta51.7
28OAOrnith-1.5-9BOrnith AI46.2
29K-EXAONE 2.0LG AI Research43.8
30STA.X K2SK Telecom36.0
31Granite 4.2 30BIBM29.2
32Granite 4.2 8BIBM20.6
33OPMiniCPM5-2BOpenBMB8.6

Evidence key: Observed

Rows are ordered by the value DeepSeek V4 Flash 0731 update published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.

All leaderboards · Coding capability leaderboard