# Decision Index Language leaderboard

external benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/leaderboards/benchmarks/external-jev-decision-index03-language

Decision Index 0.4 Language. Every model the catalog carries a published Decision Index Language value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | external |
| Measure | Chance-corrected area score |
| Tasks | Language area of the Decision Index evaluation |
| Difficulty | Language decision tasks |
| Published by | [Decision Index leaderboard](https://huggingface.co/spaces/multimodalart/jev-decision-index) |

Decision Index 0.4 publishes chance-corrected language scores for 209 evaluated systems.

## Decision Index Language ranking

120 models with a published Decision Index Language value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Chance-corrected area score | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [mammoth-1](https://modelscale.dev/models/mammoth-1) | Baseten | 67.5 | Observed 2026-10-23 · source benchlm:models |
| 2 | [Perplexity Decider v1.2 27B](https://modelscale.dev/models/pplx-decider-v1-2) | Perplexity | 65.5 | Observed 2026-10-23 · source benchlm:models |
| 3 | [Perplexity Decider v1.1 (27B)](https://modelscale.dev/models/decision-index-0-3-perplexity-decider-v1-1-27b) | Perplexity | 62.3 | Last good 2026-10-20 · source benchlm:models |
| 4 | [Perplexity Decider Flash v1.2 4B](https://modelscale.dev/models/pplx-decider-flash-v1-2) | Perplexity | 62.2 | Observed 2026-10-23 · source benchlm:models |
| 5 | [elephant-1](https://modelscale.dev/models/elephant-1) | Baseten | 62.1 | Observed 2026-10-23 · source benchlm:models |
| 6 | [Blink v0.3 26B-A4B (NVFP4)](https://modelscale.dev/models/decision-index-0-3-blink-v0-3-26b-a4b-nvfp4) | PixilabAI | 59.3 | Observed 2026-10-23 · source benchlm:models |
| 7 | [Xor 26B-A4B](https://modelscale.dev/models/decision-index-0-3-xor-26b-a4b) | juspay | 58.9 | Last good 2026-10-20 · source benchlm:models |
| 8 | [Surogate Rune 26B-A4B v3](https://modelscale.dev/models/decision-index-rune-26b-a4b-v3) | Surogate | 58.6 | Observed 2026-10-23 · source benchlm:models |
| 9 | [Fastino GLiDE no-thinking (28B)](https://modelscale.dev/models/decision-index-0-3-fastino-glide-no-thinking-28b) | Not listed | 58.3 | Observed 2026-10-23 · source benchlm:models |
| 9 | [Jebadiah 27B](https://modelscale.dev/models/decision-index-0-3-jebadiah-27b) | frontier-infra | 58.3 | Last good 2026-10-20 · source benchlm:models |
| 9 | [Jev](https://modelscale.dev/models/decision-index-0-3-jev) | Not listed | 58.3 | Last good 2026-10-20 · source benchlm:models |
| 12 | [Quyet-1.0-Large](https://modelscale.dev/models/decision-index-0-3-quyet-1-0-large) | chinhnc | 58.1 | Observed 2026-10-23 · source benchlm:models |
| 13 | [Jev 1.14](https://modelscale.dev/models/jev-1-14) | TypeSafe AI | 58.0 | Observed 2026-10-23 · source benchlm:models |
| 14 | [Kev 27B](https://modelscale.dev/models/decision-index-0-3-kev-27b) | jaredpalmer | 57.5 | Observed 2026-10-23 · source benchlm:models |
| 15 | [deck31b (Gemma 4 31B)](https://modelscale.dev/models/decision-index-0-3-deck31b-gemma-4-31b) | Not listed | 57.4 | Observed 2026-10-23 · source benchlm:models |
| 16 | [Torchcast Decision 27B](https://modelscale.dev/models/decision-index-0-3-torchcast-decision-27b) | Not listed | 57.3 | Observed 2026-10-23 · source benchlm:models |
| 17 | [JPT-35B-A3B](https://modelscale.dev/models/decision-index-0-3-jpt-35b-a3b) | kirp | 57.2 | Observed 2026-10-23 · source benchlm:models |
| 18 | [JADE](https://modelscale.dev/models/decision-index-0-3-jade) | Not listed | 56.5 | Observed 2026-10-23 · source benchlm:models |
| 19 | [simple-jev · Qwen3.8-27B](https://modelscale.dev/models/decision-index-simple-jev-qwen3-8-27b) | Featherless AI | 56.1 | Observed 2026-10-23 · source benchlm:models |
| 20 | [GEV-26B-Decide](https://modelscale.dev/models/decision-index-0-3-gev-26b-decide) | autotrust | 55.9 | Observed 2026-10-23 · source benchlm:models |
| 21 | [Decider chat · Gemma-4-31B](https://modelscale.dev/models/decision-index-decider-chat-gemma4-31b) | Mapika | 55.5 | Observed 2026-10-23 · source benchlm:models |
| 22 | [Eikos-27B](https://modelscale.dev/models/eikos-27b) | caiovicentino1 | 55.1 | Observed 2026-10-23 · source benchlm:models |
| 23 | [AJev lora5 (Gemma 4 12B)](https://modelscale.dev/models/decision-index-0-3-ajev-lora5-gemma-4-12b) | andyzhang232 | 55.0 | Last good 2026-10-20 · source benchlm:models |
| 24 | [Bespoke Nimble 9B v3](https://modelscale.dev/models/decision-index-0-3-bespoke-nimble-9b-v3) | bespokelabs | 54.6 | Observed 2026-10-23 · source benchlm:models |
| 25 | [Solomon v1.1](https://modelscale.dev/models/decision-index-0-3-solomon-v1-1) | Not listed | 54.2 | Observed 2026-10-23 · source benchlm:models |
| 26 | [vLLM-SR Decision 2.0 Vega 27B](https://modelscale.dev/models/decision-index-0-3-vllm-sr-decision-2-0-vega-27b) | Not listed | 53.9 | Observed 2026-10-23 · source benchlm:models |
| 26 | [Xor 1.2](https://modelscale.dev/models/decision-index-0-3-xor-1-2) | Not listed | 53.9 | Observed 2026-10-23 · source benchlm:models |
| 28 | [JevK5 9B v0.3.3](https://modelscale.dev/models/decision-index-0-3-jevk5-9b-v0-3-3) | alibiserikbay | 53.7 | Observed 2026-10-23 · source benchlm:models |
| 29 | [Drex v2.0](https://modelscale.dev/models/drex-v2-0) | Nace.AI | 52.7 | Observed 2026-10-23 · source benchlm:models |
| 30 | [Decider chat · Qwen3.6-27B](https://modelscale.dev/models/decision-index-0-3-decider-chat-qwen3-6-27b) | Not listed | 52.6 | Observed 2026-10-23 · source benchlm:models |
| 30 | [reflex-27b](https://modelscale.dev/models/reflex-27b) | kshetrajna12 | 52.6 | Last good 2026-10-20 · source benchlm:models |
| 32 | [JoshuaSP diffusiongemma (open-jev)](https://modelscale.dev/models/decision-index-0-3-joshuasp-diffusiongemma-open-jev) | Not listed | 51.9 | Observed 2026-10-23 · source benchlm:models |
| 33 | [JEV-27B](https://modelscale.dev/models/decision-index-0-3-jev-27b) | autotrust | 51.2 | Observed 2026-10-23 · source benchlm:models |
| 34 | [Winnow-12B Q8](https://modelscale.dev/models/winnow-12b) | Eldan Ring | 50.6 | Observed 2026-10-23 · source benchlm:models |
| 35 | [decisio 0.4.0 (Qwen3.6-35B-A3B)](https://modelscale.dev/models/decision-index-0-3-decisio-0-4-0-qwen3-6-35b-a3b) | Not listed | 50.2 | Observed 2026-10-23 · source benchlm:models |
| 36 | [djev](https://modelscale.dev/models/djev) | Maisa | 48.6 | Observed 2026-10-23 · source benchlm:models |
| 37 | [decider-35b-a3b](https://modelscale.dev/models/decider-35b-a3b) | Mapika | 48.4 | Observed 2026-10-23 · source benchlm:models |
| 38 | [jiwo 4B](https://modelscale.dev/models/decision-index-0-3-jiwo-4b) | eljiwo | 48.2 | Last good 2026-10-20 · source benchlm:models |
| 39 | [Jev-Omni](https://modelscale.dev/models/jev-omni) | akhilaaa3 | 48.1 | Observed 2026-10-23 · source benchlm:models |
| 40 | [Clef](https://modelscale.dev/models/cloudflare-clef) | Cloudflare | 47.8 | Observed 2026-10-23 · source benchlm:models |
| 41 | [mmastrac diffusiongemma (vLLM PR 57250)](https://modelscale.dev/models/decision-index-0-3-mmastrac-diffusiongemma-vllm-pr-57250) | Not listed | 47.7 | Observed 2026-10-23 · source benchlm:models |
| 42 | [ezjev 4B s2](https://modelscale.dev/models/decision-index-0-3-ezjev-4b-s2) | everettjf | 47.1 | Observed 2026-10-23 · source benchlm:models |
| 42 | [Hopper 12B (trained)](https://modelscale.dev/models/decision-index-0-3-hopper-12b-trained) | Not listed | 47.1 | Observed 2026-10-23 · source benchlm:models |
| 44 | [JPT-9B](https://modelscale.dev/models/decision-index-0-3-jpt-9b) | kirp | 46.5 | Observed 2026-10-23 · source benchlm:models |
| 45 | [JevK5 v0.3](https://modelscale.dev/models/decision-index-0-3-jevk5-v0-3) | Not listed | 46.3 | Observed 2026-10-23 · source benchlm:models |
| 45 | [razorback16 openjev diffusiongemma (NVFP4, vLLM)](https://modelscale.dev/models/decision-index-0-3-razorback16-openjev-diffusiongemma-nvfp4-vllm) | Not listed | 46.3 | Observed 2026-10-23 · source benchlm:models |
| 47 | [vLLM-SR Decision 2.0 Lux 9B](https://modelscale.dev/models/decision-index-0-3-vllm-sr-decision-2-0-lux-9b) | Not listed | 46.1 | Observed 2026-10-23 · source benchlm:models |
| 48 | [Sieve 9B](https://modelscale.dev/models/decision-index-0-3-sieve-9b) | sthanika-ai | 45.3 | Observed 2026-10-23 · source benchlm:models |
| 49 | [Jevfire](https://modelscale.dev/models/decision-index-0-3-jevfire) | Not listed | 44.7 | Observed 2026-10-23 · source benchlm:models |
| 50 | [Bespoke Nimble 9B v2](https://modelscale.dev/models/decision-index-0-3-bespoke-nimble-9b-v2) | bespokelabs | 44.4 | Observed 2026-10-23 · source benchlm:models |
| 51 | [Kev 9B v2](https://modelscale.dev/models/decision-index-0-3-kev-9b-v2) | Not listed | 44.3 | Observed 2026-10-23 · source benchlm:models |
| 52 | [decisio 0.4.0 (Gemma 4 12B)](https://modelscale.dev/models/decision-index-0-3-decisio-0-4-0-gemma-4-12b) | Not listed | 44.0 | Observed 2026-10-23 · source benchlm:models |
| 53 | [RSI-Jev v5.0 VL 3B](https://modelscale.dev/models/decision-index-0-3-rsi-jev-v5-0-vl-3b) | shgao | 42.3 | Observed 2026-10-23 · source benchlm:models |
| 54 | [vLLM-SR Decision 2.0 Nox 4B](https://modelscale.dev/models/decision-index-0-3-vllm-sr-decision-2-0-nox-4b) | Not listed | 42.2 | Observed 2026-10-23 · source benchlm:models |
| 55 | [Lev1 3.7B](https://modelscale.dev/models/decision-index-0-3-lev1-3-7b) | Not listed | 41.8 | Observed 2026-10-23 · source benchlm:models |
| 56 | [Intern-Decision-4B](https://modelscale.dev/models/decision-index-0-3-intern-decision-4b) | internlm | 41.6 | Observed 2026-10-23 · source benchlm:models |
| 57 | [Jet v6.2](https://modelscale.dev/models/decision-index-0-3-jet-v6-2) | michaljach | 41.4 | Last good 2026-10-20 · source benchlm:models |
| 57 | [Tev1-4B-experimental](https://modelscale.dev/models/decision-index-0-3-tev1-4b-experimental) | togethercomputer | 41.4 | Observed 2026-10-23 · source benchlm:models |
| 59 | [JPT-4B](https://modelscale.dev/models/decision-index-0-3-jpt-4b) | kirp | 41.3 | Observed 2026-10-23 · source benchlm:models |
| 60 | [Drex v1.5](https://modelscale.dev/models/drex-v1-5) | Nace.AI | 40.8 | Observed 2026-10-23 · source benchlm:models |
| 61 | [Clef-Omni](https://modelscale.dev/models/cloudflare-clef-omni) | Cloudflare | 40.7 | Observed 2026-10-23 · source benchlm:models |
| 61 | [JEV-9B](https://modelscale.dev/models/decision-index-0-3-jev-9b) | autotrust | 40.7 | Observed 2026-10-23 · source benchlm:models |
| 63 | [Clef-Flash](https://modelscale.dev/models/cloudflare-clef-flash) | Cloudflare | 40.5 | Observed 2026-10-23 · source benchlm:models |
| 64 | [Hopper (G) 1.2](https://modelscale.dev/models/decision-index-0-3-hopper-g-1-2) | HopitAI | 39.8 | Observed 2026-10-23 · source benchlm:models |
| 65 | [Kas 4B](https://modelscale.dev/models/decision-index-0-3-kas-4b) | kpiya | 37.6 | Observed 2026-10-23 · source benchlm:models |
| 66 | [Winnow-E4B](https://modelscale.dev/models/decision-index-0-3-winnow-e4b) | EldanRing | 37.5 | Observed 2026-10-23 · source benchlm:models |
| 67 | [Jevstral 8B](https://modelscale.dev/models/decision-index-0-3-jevstral-8b) | AmirBraham | 37.3 | Observed 2026-10-23 · source benchlm:models |
| 68 | [metask-jev-4b](https://modelscale.dev/models/metask-jev-4b) | Wayfind (metask-ai) | 37.0 | Observed 2026-10-23 · source benchlm:models |
| 69 | [open-jev (pngwn)](https://modelscale.dev/models/decision-index-0-3-open-jev-pngwn) | Not listed | 36.9 | Observed 2026-10-23 · source benchlm:models |
| 70 | [Intelif Qwen3-4B](https://modelscale.dev/models/decision-index-0-3-intelif-qwen3-4b) | Not listed | 36.6 | Observed 2026-10-23 · source benchlm:models |
| 71 | [Jobe](https://modelscale.dev/models/decision-index-0-3-jobe) | Not listed | 36.0 | Observed 2026-10-23 · source benchlm:models |
| 72 | [SemIf](https://modelscale.dev/models/decision-index-0-3-semif) | Not listed | 35.9 | Observed 2026-10-23 · source benchlm:models |
| 73 | [Kev 4B r10](https://modelscale.dev/models/decision-index-0-3-kev-4b-r10) | jaredpalmer | 35.6 | Observed 2026-10-23 · source benchlm:models |
| 74 | [NeoHorse-Jev-4B](https://modelscale.dev/models/decision-index-0-3-neohorse-jev-4b) | TokenRhythm | 34.2 | Observed 2026-10-23 · source benchlm:models |
| 75 | [Decider 4B](https://modelscale.dev/models/decision-index-0-3-decider-4b) | Mapika | 33.9 | Observed 2026-10-23 · source benchlm:models |
| 76 | [jiwo 0.8B](https://modelscale.dev/models/decision-index-0-3-jiwo-0-8b) | eljiwo | 33.7 | Last good 2026-10-20 · source benchlm:models |
| 77 | [Ryotide Qwen v0.3.1](https://modelscale.dev/models/decision-index-0-3-ryotide-qwen-v0-3-1) | Not listed | 33.2 | Observed 2026-10-23 · source benchlm:models |
| 78 | [openvons](https://modelscale.dev/models/decision-index-0-3-openvons) | Not listed | 31.7 | Observed 2026-10-23 · source benchlm:models |
| 79 | [Jev-Style 2B v3](https://modelscale.dev/models/decision-index-0-3-jev-style-2b-v3) | Not listed | 30.0 | Observed 2026-10-23 · source benchlm:models |
| 80 | [lev](https://modelscale.dev/models/decision-index-0-3-lev) | interfaze-ai | 29.5 | Observed 2026-10-23 · source benchlm:models |
| 81 | [mini-jev](https://modelscale.dev/models/decision-index-0-3-mini-jev) | Not listed | 29.1 | Observed 2026-10-23 · source benchlm:models |
| 82 | [Intern-Decision-2B](https://modelscale.dev/models/decision-index-0-3-intern-decision-2b) | internlm | 28.8 | Observed 2026-10-23 · source benchlm:models |
| 83 | [Gevva E4B](https://modelscale.dev/models/decision-index-0-3-gevva-e4b) | davidburhans | 28.3 | Observed 2026-10-23 · source benchlm:models |
| 84 | [decider-2b](https://modelscale.dev/models/decider-2b) | Mapika | 27.4 | Observed 2026-10-23 · source benchlm:models |
| 85 | [vLLM-SR Decision 2.0 Sol 2B](https://modelscale.dev/models/decision-index-0-3-vllm-sr-decision-2-0-sol-2b) | Not listed | 24.0 | Observed 2026-10-23 · source benchlm:models |
| 86 | [this-that 1.2](https://modelscale.dev/models/decision-index-0-3-this-that-1-2) | Not listed | 23.4 | Observed 2026-10-23 · source benchlm:models |
| 87 | [EXAONE-4.0-1.2B-JEV v0.3](https://modelscale.dev/models/decision-index-0-3-exaone-4-0-1-2b-jev-v0-3) | Not listed | 22.2 | Observed 2026-10-23 · source benchlm:models |
| 88 | [Sieve 2B](https://modelscale.dev/models/decision-index-0-3-sieve-2b) | sthanika-ai | 21.7 | Observed 2026-10-23 · source benchlm:models |
| 89 | [Gevva E2B](https://modelscale.dev/models/decision-index-0-3-gevva-e2b) | davidburhans | 21.2 | Observed 2026-10-23 · source benchlm:models |
| 90 | [vLLM-SR Decision 2.0 Eos 0.8B](https://modelscale.dev/models/decision-index-0-3-vllm-sr-decision-2-0-eos-0-8b) | Not listed | 19.7 | Observed 2026-10-23 · source benchlm:models |
| 91 | [Bekko System One v0 400M](https://modelscale.dev/models/decision-index-0-3-bekko-system-one-v0-400m) | hotchpotch | 19.6 | Observed 2026-10-23 · source benchlm:models |
| 92 | [JPT-0.8B](https://modelscale.dev/models/decision-index-0-3-jpt-0-8b) | kirp | 19.3 | Observed 2026-10-23 · source benchlm:models |
| 93 | [Dinah-0](https://modelscale.dev/models/decision-index-0-3-dinah-0) | Lukitaduarte | 15.7 | Last good 2026-10-20 · source benchlm:models |
| 94 | [GLiNER2.5-Decide](https://modelscale.dev/models/decision-index-0-3-gliner2-5-decide) | fastino | 15.5 | Observed 2026-10-23 · source benchlm:models |
| 94 | [OneJev 0.8B](https://modelscale.dev/models/decision-index-0-3-onejev-0-8b) | OmniJev | 15.5 | Last good 2026-10-20 · source benchlm:models |
| 96 | [Bosun v3.1 1.7B](https://modelscale.dev/models/decision-index-0-3-bosun-v3-1-1-7b) | Hanno-Labs | 14.7 | Observed 2026-10-23 · source benchlm:models |
| 96 | [Von 1.3](https://modelscale.dev/models/decision-index-0-3-von-1-3) | Not listed | 14.7 | Observed 2026-10-23 · source benchlm:models |
| 98 | [Laya](https://modelscale.dev/models/laya) | Convai Innovations | 14.6 | Observed 2026-10-23 · source benchlm:models |
| 99 | [Tev1-0.8B-experimental](https://modelscale.dev/models/decision-index-0-3-tev1-0-8b-experimental) | togethercomputer | 14.4 | Observed 2026-10-23 · source benchlm:models |
| 100 | [Sifr 0.8B v3.1](https://modelscale.dev/models/decision-index-0-3-sifr-0-8b-v3-1) | Not listed | 14.3 | Observed 2026-10-23 · source benchlm:models |
| 101 | [JevK5 Lite](https://modelscale.dev/models/decision-index-0-3-jevk5-lite) | alibiserikbay | 13.8 | Observed 2026-10-23 · source benchlm:models |
| 102 | [vLLM-SR Decision 2.0 Kai 0.6B](https://modelscale.dev/models/decision-index-0-3-vllm-sr-decision-2-0-kai-0-6b) | Not listed | 13.1 | Observed 2026-10-23 · source benchlm:models |
| 103 | [Kev 0.8B r15](https://modelscale.dev/models/decision-index-0-3-kev-0-8b-r15) | Not listed | 12.4 | Observed 2026-10-23 · source benchlm:models |
| 104 | [Jev-Style 0.8B v3](https://modelscale.dev/models/decision-index-0-3-jev-style-0-8b-v3) | Not listed | 12.0 | Observed 2026-10-23 · source benchlm:models |
| 105 | [Kodiak v0.2 1B (accuracy)](https://modelscale.dev/models/decision-index-0-3-kodiak-v0-2-1b-accuracy) | cortex-agent-llc | 10.6 | Observed 2026-10-23 · source benchlm:models |
| 106 | [Lavoir](https://modelscale.dev/models/decision-index-0-3-lavoir) | moganai | 9.2 | Observed 2026-10-23 · source benchlm:models |
| 107 | [Intern-Decision-0.8B](https://modelscale.dev/models/decision-index-0-3-intern-decision-0-8b) | internlm | 8.4 | Observed 2026-10-23 · source benchlm:models |
| 108 | [jeff](https://modelscale.dev/models/jeff) | Logan Markewich | 7.8 | Observed 2026-10-23 · source benchlm:models |
| 109 | [Qwen-2.5-1B-RLCD](https://modelscale.dev/models/decision-index-0-3-qwen-2-5-1b-rlcd) | harshatheg | 7.7 | Observed 2026-10-23 · source benchlm:models |
| 110 | [Bekko System One v0 68M](https://modelscale.dev/models/decision-index-0-3-bekko-system-one-v0-68m) | hotchpotch | 6.5 | Observed 2026-10-23 · source benchlm:models |
| 111 | [CLM-v0.1-8B](https://modelscale.dev/models/decision-index-0-3-clm-v0-1-8b) | Contrastive-LM | 5.7 | Observed 2026-10-23 · source benchlm:models |
| 112 | [LFM2.5-2.6B-RLCD](https://modelscale.dev/models/decision-index-0-3-lfm2-5-2-6b-rlcd) | monotykamary | 5.4 | Observed 2026-10-23 · source benchlm:models |
| 113 | [Bosun v3.1 0.6B](https://modelscale.dev/models/bosun-v31-0-6b) | Clause Logic | 5.1 | Observed 2026-10-23 · source benchlm:models |
| 114 | [DM-JEPA 1.1](https://modelscale.dev/models/decision-index-0-3-dm-jepa-1-1) | Not listed | 2.6 | Observed 2026-10-23 · source benchlm:models |
| 115 | [LFM2.5-350M-RLCD](https://modelscale.dev/models/decision-index-0-3-lfm2-5-350m-rlcd) | notnotsamuel | 2.0 | Observed 2026-10-23 · source benchlm:models |
| 116 | [Zev](https://modelscale.dev/models/decision-index-0-3-zev) | Not listed | 1.8 | Observed 2026-10-23 · source benchlm:models |
| 117 | [system-one-gemma](https://modelscale.dev/models/decision-index-0-3-system-one-gemma) | Not listed | 1.7 | Observed 2026-10-23 · source benchlm:models |
| 118 | [Julia 1](https://modelscale.dev/models/decision-index-0-3-julia-1) | SupersonicLabs | 1.5 | Observed 2026-10-23 · source benchlm:models |
| 119 | [Bekko System One v0 17M](https://modelscale.dev/models/decision-index-0-3-bekko-system-one-v0-17m) | hotchpotch | 0.6 | Observed 2026-10-23 · source benchlm:models |
| 120 | [Verdict](https://modelscale.dev/models/decision-index-0-3-verdict) | Not listed | 0.0 | Observed 2026-10-23 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.