Loading page…
Preferred languages
More languages supported by Google Translate
Open the selector to load the current language catalog.
Translations are provided by Google Translate.
Loading page…
Preferred languages
More languages supported by Google Translate
Open the selector to load the current language catalog.
Translations are provided by Google Translate.
external benchmark
Decision Index 0.4 Language. Every model the catalog carries a published Decision Index Language value for, ranked by that value.
Decision Index 0.4 publishes chance-corrected language scores for 209 evaluated systems.
120 models with a published Decision Index Language value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.
| Rank | Model | Provider | Chance-corrected area score |
|---|---|---|---|
| 1 | BAmammoth-1 | Baseten | 67.5 |
| 2 | Perplexity | 65.5 | |
| 3 | Perplexity | 62.3 |
What the benchmark measures and how its value is published, from the source’s own record.
Decision Index Language (Decision Index 0.4 Language) is an external benchmark published by Decision Index leaderboard. Decision Index 0.4 publishes chance-corrected language scores for 209 evaluated systems. Its evaluation set is described by the source as language area of the Decision Index evaluation. The source rates its difficulty as language decision tasks.
Each model's result is published by Decision Index leaderboard as chance-corrected area score. ModelScale prints that value to 1 decimal place, exactly as published, and never converts or rescales it. This page ranks the 120 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.
| 4 | Perplexity | 62.2 |
| 5 | BAelephant-1 | Baseten | 62.1 |
| 6 | PIBlink v0.3 26B-A4B (NVFP4) | PixilabAI | 59.3 |
| 7 | JUXor 26B-A4B | juspay | 58.9 |
| 8 | SUSurogate Rune 26B-A4B v3 | Surogate | 58.6 |
| 9 | NLFastino GLiDE no-thinking (28B) | Not listed | 58.3 |
| 9 | FIJebadiah 27B | frontier-infra | 58.3 |
| 9 | NLJev | Not listed | 58.3 |
| 12 | CHQuyet-1.0-Large | chinhnc | 58.1 |
| 13 | TAJev 1.14 | TypeSafe AI | 58.0 |
| 14 | JAKev 27B | jaredpalmer | 57.5 |
| 15 | NLdeck31b (Gemma 4 31B) | Not listed | 57.4 |
| 16 | NLTorchcast Decision 27B | Not listed | 57.3 |
| 17 | KIJPT-35B-A3B | kirp | 57.2 |
| 18 | NLJADE | Not listed | 56.5 |
| 19 | FAsimple-jev · Qwen3.8-27B | Featherless AI | 56.1 |
| 20 | AUGEV-26B-Decide | autotrust | 55.9 |
| 21 | MADecider chat · Gemma-4-31B | Mapika | 55.5 |
| 22 | CAEikos-27B | caiovicentino1 | 55.1 |
| 23 | ANAJev lora5 (Gemma 4 12B) | andyzhang232 | 55.0 |
| 24 | BEBespoke Nimble 9B v3 | bespokelabs | 54.6 |
| 25 | NLSolomon v1.1 | Not listed | 54.2 |
| 26 | NLvLLM-SR Decision 2.0 Vega 27B | Not listed | 53.9 |
| 26 | NLXor 1.2 | Not listed | 53.9 |
| 28 | ALJevK5 9B v0.3.3 | alibiserikbay | 53.7 |
| 29 | NADrex v2.0 | Nace.AI | 52.7 |
| 30 | NLDecider chat · Qwen3.6-27B | Not listed | 52.6 |
| 30 | KSreflex-27b | kshetrajna12 | 52.6 |
| 32 | NLJoshuaSP diffusiongemma (open-jev) | Not listed | 51.9 |
| 33 | AUJEV-27B | autotrust | 51.2 |
| 34 | ERWinnow-12B Q8 | Eldan Ring | 50.6 |
| 35 | NLdecisio 0.4.0 (Qwen3.6-35B-A3B) | Not listed | 50.2 |
| 36 | MAdjev | Maisa | 48.6 |
| 37 | MAdecider-35b-a3b | Mapika | 48.4 |
| 38 | ELjiwo 4B | eljiwo | 48.2 |
| 39 | AKJev-Omni | akhilaaa3 | 48.1 |
| 40 | CLClef | Cloudflare | 47.8 |
| 41 | NLmmastrac diffusiongemma (vLLM PR 57250) | Not listed | 47.7 |
| 42 | EVezjev 4B s2 | everettjf | 47.1 |
| 42 | NLHopper 12B (trained) | Not listed | 47.1 |
| 44 | KIJPT-9B | kirp | 46.5 |
| 45 | NLJevK5 v0.3 | Not listed | 46.3 |
| 45 | NLrazorback16 openjev diffusiongemma (NVFP4, vLLM) | Not listed | 46.3 |
| 47 | NLvLLM-SR Decision 2.0 Lux 9B | Not listed | 46.1 |
| 48 | SASieve 9B | sthanika-ai | 45.3 |
| 49 | NLJevfire | Not listed | 44.7 |
| 50 | BEBespoke Nimble 9B v2 | bespokelabs | 44.4 |
| 51 | NLKev 9B v2 | Not listed | 44.3 |
| 52 | NLdecisio 0.4.0 (Gemma 4 12B) | Not listed | 44.0 |
| 53 | SHRSI-Jev v5.0 VL 3B | shgao | 42.3 |
| 54 | NLvLLM-SR Decision 2.0 Nox 4B | Not listed | 42.2 |
| 55 | NLLev1 3.7B | Not listed | 41.8 |
| 56 | internlm | 41.6 |
| 57 | MIJet v6.2 | michaljach | 41.4 |
| 57 | TOTev1-4B-experimental | togethercomputer | 41.4 |
| 59 | KIJPT-4B | kirp | 41.3 |
| 60 | NADrex v1.5 | Nace.AI | 40.8 |
| 61 | CLClef-Omni | Cloudflare | 40.7 |
| 61 | AUJEV-9B | autotrust | 40.7 |
| 63 | CLClef-Flash | Cloudflare | 40.5 |
| 64 | HOHopper (G) 1.2 | HopitAI | 39.8 |
| 65 | KPKas 4B | kpiya | 37.6 |
| 66 | ELWinnow-E4B | EldanRing | 37.5 |
| 67 | AMJevstral 8B | AmirBraham | 37.3 |
| 68 | W(metask-jev-4b | Wayfind (metask-ai) | 37.0 |
| 69 | NLopen-jev (pngwn) | Not listed | 36.9 |
| 70 | NLIntelif Qwen3-4B | Not listed | 36.6 |
| 71 | NLJobe | Not listed | 36.0 |
| 72 | NLSemIf | Not listed | 35.9 |
| 73 | JAKev 4B r10 | jaredpalmer | 35.6 |
| 74 | TONeoHorse-Jev-4B | TokenRhythm | 34.2 |
| 75 | MADecider 4B | Mapika | 33.9 |
| 76 | ELjiwo 0.8B | eljiwo | 33.7 |
| 77 | NLRyotide Qwen v0.3.1 | Not listed | 33.2 |
| 78 | NLopenvons | Not listed | 31.7 |
| 79 | NLJev-Style 2B v3 | Not listed | 30.0 |
| 80 | IAlev | interfaze-ai | 29.5 |
| 81 | NLmini-jev | Not listed | 29.1 |
| 82 | internlm | 28.8 |
| 83 | DAGevva E4B | davidburhans | 28.3 |
| 84 | MAdecider-2b | Mapika | 27.4 |
| 85 | NLvLLM-SR Decision 2.0 Sol 2B | Not listed | 24.0 |
| 86 | NLthis-that 1.2 | Not listed | 23.4 |
| 87 | NLEXAONE-4.0-1.2B-JEV v0.3 | Not listed | 22.2 |
| 88 | SASieve 2B | sthanika-ai | 21.7 |
| 89 | DAGevva E2B | davidburhans | 21.2 |
| 90 | NLvLLM-SR Decision 2.0 Eos 0.8B | Not listed | 19.7 |
| 91 | HOBekko System One v0 400M | hotchpotch | 19.6 |
| 92 | KIJPT-0.8B | kirp | 19.3 |
| 93 | LUDinah-0 | Lukitaduarte | 15.7 |
| 94 | FAGLiNER2.5-Decide | fastino | 15.5 |
| 94 | OMOneJev 0.8B | OmniJev | 15.5 |
| 96 | HLBosun v3.1 1.7B | Hanno-Labs | 14.7 |
| 96 | NLVon 1.3 | Not listed | 14.7 |
| 98 | CILaya | Convai Innovations | 14.6 |
| 99 | TOTev1-0.8B-experimental | togethercomputer | 14.4 |
| 100 | NLSifr 0.8B v3.1 | Not listed | 14.3 |
| 101 | ALJevK5 Lite | alibiserikbay | 13.8 |
| 102 | NLvLLM-SR Decision 2.0 Kai 0.6B | Not listed | 13.1 |
| 103 | NLKev 0.8B r15 | Not listed | 12.4 |
| 104 | NLJev-Style 0.8B v3 | Not listed | 12.0 |
| 105 | CAKodiak v0.2 1B (accuracy) | cortex-agent-llc | 10.6 |
| 106 | MOLavoir | moganai | 9.2 |
| 107 | internlm | 8.4 |
| 108 | LMjeff | Logan Markewich | 7.8 |
| 109 | HAQwen-2.5-1B-RLCD | harshatheg | 7.7 |
| 110 | HOBekko System One v0 68M | hotchpotch | 6.5 |
| 111 | CLCLM-v0.1-8B | Contrastive-LM | 5.7 |
| 112 | MOLFM2.5-2.6B-RLCD | monotykamary | 5.4 |
| 113 | CLBosun v3.1 0.6B | Clause Logic | 5.1 |
| 114 | NLDM-JEPA 1.1 | Not listed | 2.6 |
| 115 | NOLFM2.5-350M-RLCD | notnotsamuel | 2.0 |
| 116 | NLZev | Not listed | 1.8 |
| 117 | NLsystem-one-gemma | Not listed | 1.7 |
| 118 | SUJulia 1 | SupersonicLabs | 1.5 |
| 119 | HOBekko System One v0 17M | hotchpotch | 0.6 |
| 120 | NLVerdict | Not listed | 0.0 |
Evidence key: ObservedLast good
Rows are ordered by the value Decision Index leaderboard published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.