# JevBench 1.4 leaderboard

Reasoning benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/leaderboards/benchmarks/reasoning-jev-bench14

Every model the catalog carries a published JevBench 1.4 value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Reasoning |
| Measure | Equal-weight harmonic composite with gates |
| Tasks | 534 frozen v1.2 decisions plus 308 sealed v1.4 decisions |
| Difficulty | Typed decisions with sealed generalization tests |
| Published by | [JevBench v1.4 method](https://github.com/fstandhartinger/jevbench/blob/5b405e7e4efff2cfbbb2fe67db9b0cbad0704b8d/docs/METHOD-v1.4.md) |

Decision-system evaluation combining chance-corrected intelligence, probability calibration, latency, and cost across 842 decisions.

## JevBench 1.4 ranking

184 models with a published JevBench 1.4 value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Equal-weight harmonic composite with gates | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [classifier.dev (fast tier)](https://modelscale.dev/models/jevbench-classifier-dev-fast) | mrmps (@michael_chomsky) | 70.82 | Last good 2026-10-01 · source benchlm:models |
| 1 | [classifier.dev (fast)](https://modelscale.dev/models/classifier-dev-fast) | classifier.dev | 70.82 | Observed 2026-10-23 · source benchlm:models |
| 3 | [Imajev-4B](https://modelscale.dev/models/imajev-4b) | mohit67890 | 67.37 | Observed 2026-10-23 · source benchlm:models |
| 3 | [Imajev-4B](https://modelscale.dev/models/jevbench-imajev-4b) | mohit67890 | 67.37 | Last good 2026-10-01 · source benchlm:models |
| 5 | [Plumb-4B](https://modelscale.dev/models/plumb-4b) | crh225 | 65.84 | Observed 2026-10-23 · source benchlm:models |
| 5 | [Plumb-4B (crh225, JevK5 v0.2 + LoRA)](https://modelscale.dev/models/jevbench-plumb-4b) | crh225 | 65.84 | Last good 2026-10-01 · source benchlm:models |
| 7 | [decider-4b v2](https://modelscale.dev/models/decider-4b-v2) | Mapika | 64.13 | Observed 2026-10-23 · source benchlm:models |
| 7 | [decider-4b v2 (Mapika)](https://modelscale.dev/models/jevbench-decider-4b-v2) | Mapika | 64.13 | Last good 2026-10-01 · source benchlm:models |
| 9 | [Jev 1.13.0](https://modelscale.dev/models/jev-1-13-0) | TypeSafe AI | 63.29 | Observed 2026-10-23 · source benchlm:models |
| 9 | [Jev 1.13.0 (TypeSafe AI)](https://modelscale.dev/models/jevbench-jev-1-13-0) | TypeSafe AI | 63.29 | Last good 2026-10-01 · source benchlm:models |
| 11 | [JevK5 v0.2.0](https://modelscale.dev/models/jevbench-jevk5-v02) | allebee | 62.04 | Last good 2026-10-01 · source benchlm:models |
| 11 | [JevK5 v0.2.0](https://modelscale.dev/models/jevk5-v0-2-0) | allebee | 62.04 | Observed 2026-10-23 · source benchlm:models |
| 13 | [Cygnet](https://modelscale.dev/models/cygnet) | blockbrain | 61.76 | Observed 2026-10-23 · source benchlm:models |
| 13 | [Cygnet (blockbrain, frozen Gemma-4-12B-it)](https://modelscale.dev/models/jevbench-cygnet) | blockbrain | 61.76 | Last good 2026-10-01 · source benchlm:models |
| 15 | [Hopper](https://modelscale.dev/models/hopper) | HopitAI | 59.43 | Observed 2026-10-23 · source benchlm:models |
| 15 | [Hopper](https://modelscale.dev/models/jevbench-hopper) | HopitAI | 59.43 | Last good 2026-10-01 · source benchlm:models |
| 17 | [Winnow-12B Q8](https://modelscale.dev/models/jevbench-winnow-12b) | Eldan Ring | 55.58 | Last good 2026-10-01 · source benchlm:models |
| 17 | [Winnow-12B Q8](https://modelscale.dev/models/winnow-12b) | Eldan Ring | 55.58 | Observed 2026-10-23 · source benchlm:models |
| 19 | [reflex 4B](https://modelscale.dev/models/reflex-4b) | kshetrajna12 | 53.99 | Observed 2026-10-23 · source benchlm:models |
| 19 | [reflex 4B (kshetrajna12)](https://modelscale.dev/models/jevbench-reflex-4b) | kshetrajna12 | 53.99 | Last good 2026-10-01 · source benchlm:models |
| 21 | [djev](https://modelscale.dev/models/djev) | Maisa | 52.23 | Observed 2026-10-23 · source benchlm:models |
| 21 | [djev (Maisa, diffusion-gemma)](https://modelscale.dev/models/jevbench-djev) | Maisa (David Villalón) | 52.23 | Last good 2026-10-01 · source benchlm:models |
| 23 | [Jev-Omni](https://modelscale.dev/models/jev-omni) | akhilaaa3 | 51.34 | Observed 2026-10-23 · source benchlm:models |
| 23 | [Jev-Omni (akhilaaa3, Gemma-4-12B merged)](https://modelscale.dev/models/jevbench-jev-omni) | akhilaaa3 | 51.34 | Last good 2026-10-01 · source benchlm:models |
| 25 | [metask-jev-4b](https://modelscale.dev/models/jevbench-metask-jev-4b) | Wayfind (metask-ai) | 47.78 | Last good 2026-10-01 · source benchlm:models |
| 25 | [metask-jev-4b](https://modelscale.dev/models/metask-jev-4b) | Wayfind (metask-ai) | 47.78 | Observed 2026-10-23 · source benchlm:models |
| 27 | [SemIf Qwen3.5-4B](https://modelscale.dev/models/semif-qwen3-5-4b) | Theodore Lee (TheoLeeCJ) | 47.69 | Observed 2026-10-23 · source benchlm:models |
| 27 | [SemIf, formerly OpenJev (Qwen3.5-4B, TheoLeeCJ)](https://modelscale.dev/models/jevbench-semif-qwen3-5-4b) | Theodore Lee (TheoLeeCJ) | 47.69 | Last good 2026-10-01 · source benchlm:models |
| 29 | [Jobe Qwen3.5-4B](https://modelscale.dev/models/jobe-qwen3-5-4b) | MantisShrimpdev | 46.94 | Observed 2026-10-23 · source benchlm:models |
| 29 | [Jobe Qwen3.5-4B (frozen)](https://modelscale.dev/models/jevbench-jobe-qwen3-5-4b) | MantisShrimpdev | 46.94 | Last good 2026-10-01 · source benchlm:models |
| 31 | [local-jev Qwen3.5-4B](https://modelscale.dev/models/jevbench-localjev-qwen3-5-4b) | Amith Chandrappa (amithgc) | 46.80 | Last good 2026-10-01 · source benchlm:models |
| 31 | [local-jev Qwen3.5-4B](https://modelscale.dev/models/localjev-qwen3-5-4b) | Amith Chandrappa (amithgc) | 46.80 | Observed 2026-10-23 · source benchlm:models |
| 33 | [system-one-open](https://modelscale.dev/models/system-one-open) | mithalouni | 45.11 | Observed 2026-10-23 · source benchlm:models |
| 33 | [system-one-open (Gemma 4 E2B LoRA on an L4)](https://modelscale.dev/models/jevbench-system-one-open) | mithalouni | 45.11 | Last good 2026-10-01 · source benchlm:models |
| 35 | [spark-s1-4b-v6](https://modelscale.dev/models/spark-s1-4b-v6) | Abhishek Rai (abhishek085) | 44.62 | Observed 2026-10-23 · source benchlm:models |
| 35 | [spark-s1-4b-v6 (Open Spark Jev, abhishek085)](https://modelscale.dev/models/jevbench-spark-s1-4b-v6) | Abhishek Rai (abhishek085) | 44.62 | Last good 2026-10-01 · source benchlm:models |
| 37 | [Malkuth-4B](https://modelscale.dev/models/malkuth-4b) | newfull5 (dhtocks) | 44.45 | Observed 2026-10-23 · source benchlm:models |
| 37 | [Malkuth-4B (newfull5, Kev post-train)](https://modelscale.dev/models/jevbench-malkuth-4b) | newfull5 (dhtocks) | 44.45 | Last good 2026-10-01 · source benchlm:models |
| 39 | [jqv (Qwen3-32B zero-shot)](https://modelscale.dev/models/jevbench-jqv) | hjmurmur (Octalab) | 44.35 | Last good 2026-10-01 · source benchlm:models |
| 39 | [jqv Qwen3-32B](https://modelscale.dev/models/jqv) | Octalab | 44.35 | Observed 2026-10-23 · source benchlm:models |
| 41 | [Qwen3-Reranker-4B](https://modelscale.dev/models/jevbench-qwen3-reranker-4b) | Qwen | 43.49 | Last good 2026-10-01 · source benchlm:models |
| 41 | [Qwen3-Reranker-4B](https://modelscale.dev/models/qwen3-reranker-4b) | Alibaba | 43.49 | Observed 2026-10-23 · source benchlm:models |
| 43 | [decider-35b-a3b](https://modelscale.dev/models/decider-35b-a3b) | Mapika | 41.18 | Observed 2026-10-23 · source benchlm:models |
| 43 | [decider-35b-a3b (Mapika)](https://modelscale.dev/models/jevbench-decider-35b-a3b) | Mapika | 41.18 | Last good 2026-10-01 · source benchlm:models |
| 45 | [Raw Qwen3 4B Instruct 2507 direct logits](https://modelscale.dev/models/jevbench-raw-qwen3-4b-instruct-2507) | Alibaba Qwen / neutral reproduction | 40.95 | Last good 2026-10-01 · source benchlm:models |
| 45 | [Raw Qwen3 4B Instruct 2507 direct logits](https://modelscale.dev/models/raw-qwen3-4b-instruct-2507) | Alibaba | 40.95 | Observed 2026-10-23 · source benchlm:models |
| 47 | [OpenSourceJev (Qwen3.5-4B Q4_K_M, native llama.cpp)](https://modelscale.dev/models/jevbench-opensourcejev-qwen35-4b-q4km) | sabeel111 | 40.87 | Last good 2026-10-01 · source benchlm:models |
| 47 | [OpenSourceJev Qwen3.5-4B Q4_K_M](https://modelscale.dev/models/opensourcejev-qwen35-4b-q4km) | sabeel111 | 40.87 | Observed 2026-10-23 · source benchlm:models |
| 49 | [ZeroEntropy zerank-2](https://modelscale.dev/models/jevbench-zerank-2) | ZeroEntropy | 40.21 | Last good 2026-10-01 · source benchlm:models |
| 49 | [ZeroEntropy zerank-2](https://modelscale.dev/models/zerank-2) | ZeroEntropy | 40.21 | Observed 2026-10-23 · source benchlm:models |
| 51 | [decision-machine-1](https://modelscale.dev/models/decision-machine-1) | milliseconds.ai | 39.94 | Observed 2026-10-23 · source benchlm:models |
| 51 | [decision-machine-1 (milliseconds.ai)](https://modelscale.dev/models/jevbench-decision-machine-1) | milliseconds.ai (Baptiste Laget) | 39.94 | Last good 2026-10-01 · source benchlm:models |
| 53 | [Malkuth-2B](https://modelscale.dev/models/malkuth-2b) | newfull5 (dhtocks) | 38.93 | Observed 2026-10-23 · source benchlm:models |
| 53 | [Malkuth-2B (newfull5, Kev post-train)](https://modelscale.dev/models/jevbench-malkuth-2b) | newfull5 (dhtocks) | 38.93 | Last good 2026-10-01 · source benchlm:models |
| 55 | [Raw Phi-4 mini direct logits](https://modelscale.dev/models/jevbench-raw-phi-4-mini) | Microsoft / neutral reproduction | 37.96 | Last good 2026-10-01 · source benchlm:models |
| 55 | [Raw Phi-4 mini direct logits](https://modelscale.dev/models/raw-phi-4-mini) | Microsoft | 37.96 | Observed 2026-10-23 · source benchlm:models |
| 57 | [JEV Qwen3.5-9B Base NVFP4](https://modelscale.dev/models/jev-qwen3-5-9b-base-nvfp4) | WilfLin | 37.70 | Observed 2026-10-23 · source benchlm:models |
| 57 | [JEV Qwen3.5-9B Base NVFP4](https://modelscale.dev/models/jevbench-jev-qwen3-5-9b-base-nvfp4) | WilfLin | 37.70 | Last good 2026-10-01 · source benchlm:models |
| 59 | [OpenJev (DiffusionGemma 26B-A4B NVFP4, razorback16)](https://modelscale.dev/models/jevbench-openjev-razorback16) | razorback16 / Codiv | 36.85 | Last good 2026-10-01 · source benchlm:models |
| 59 | [OpenJev DiffusionGemma 26B-A4B NVFP4](https://modelscale.dev/models/openjev-razorback16) | razorback16 / Codiv | 36.85 | Observed 2026-10-23 · source benchlm:models |
| 61 | [kev 4B](https://modelscale.dev/models/kev-4b) | Jared Palmer | 36.14 | Observed 2026-10-23 · source benchlm:models |
| 61 | [kev 4B (research preview)](https://modelscale.dev/models/jevbench-kev-4b) | Jared Palmer | 36.14 | Last good 2026-10-01 · source benchlm:models |
| 63 | [Decision 2B (FlyMy.AI, v59)](https://modelscale.dev/models/jevbench-decision-2b) | FlyMy.AI (@denti) | 35.80 | Last good 2026-10-01 · source benchlm:models |
| 63 | [Decision 2B v59](https://modelscale.dev/models/decision-2b) | FlyMy.AI | 35.80 | Observed 2026-10-23 · source benchlm:models |
| 65 | [Qwen3.5-9B Jev-like data-mix v2](https://modelscale.dev/models/jevbench-qwen35-9b-jev-data-mix-v2) | jsaurabh | 35.24 | Last good 2026-10-01 · source benchlm:models |
| 65 | [Qwen3.5-9B Jev-like data-mix v2](https://modelscale.dev/models/qwen35-9b-jev-data-mix-v2) | jsaurabh | 35.24 | Observed 2026-10-23 · source benchlm:models |
| 67 | [GPT-6 Luna (low reasoning effort)](https://modelscale.dev/models/jevbench-gpt-6-luna-low) | OpenAI | 35.11 | Last good 2026-10-01 · source benchlm:models |
| 67 | [GPT-6 Luna (low)](https://modelscale.dev/models/gpt-6-luna-low) | OpenAI | 35.11 | Observed 2026-10-23 · source benchlm:models |
| 69 | [SimpleJev Qwen3.8-27B](https://modelscale.dev/models/jevbench-simplejev-qwen3-8-27b) | Featherless AI | 34.57 | Last good 2026-10-01 · source benchlm:models |
| 69 | [SimpleJev Qwen3.8-27B](https://modelscale.dev/models/simplejev-qwen3-8-27b) | Featherless AI | 34.57 | Observed 2026-10-23 · source benchlm:models |
| 71 | [NInfer Qwen3.8-Flash-Next mixed](https://modelscale.dev/models/jevbench-ninfer-qwen3-8-flash-next) | Igor L. / NInfer contributors | 33.98 | Last good 2026-10-01 · source benchlm:models |
| 71 | [NInfer Qwen3.8-Flash-Next mixed](https://modelscale.dev/models/ninfer-qwen3-8-flash-next) | Igor L. / NInfer contributors | 33.98 | Observed 2026-10-23 · source benchlm:models |
| 73 | [swanOne](https://modelscale.dev/models/swanone) | blockbrain | 33.61 | Observed 2026-10-23 · source benchlm:models |
| 73 | [swanOne (blockbrain, Qwen3.8-Flash-Next NVFP4)](https://modelscale.dev/models/jevbench-swanone) | blockbrain | 33.61 | Last good 2026-10-01 · source benchlm:models |
| 75 | [GPT-6 Luna (default medium reasoning effort)](https://modelscale.dev/models/jevbench-gpt-6-luna) | OpenAI | 33.27 | Last good 2026-10-01 · source benchlm:models |
| 75 | [GPT-6 Luna (medium)](https://modelscale.dev/models/gpt-6-luna-medium) | OpenAI | 33.27 | Observed 2026-10-23 · source benchlm:models |
| 77 | [open-alternative-jev (Qwen3.5-4B, IkerMoel)](https://modelscale.dev/models/jevbench-open-alternative-jev) | IkerMoel | 33.24 | Last good 2026-10-01 · source benchlm:models |
| 77 | [open-alternative-jev Qwen3.5-4B](https://modelscale.dev/models/open-alternative-jev) | IkerMoel | 33.24 | Observed 2026-10-23 · source benchlm:models |
| 79 | [jev-local (Qwen3.5-9B)](https://modelscale.dev/models/jevbench-jev-local) | us (GitHub) | 32.54 | Last good 2026-10-01 · source benchlm:models |
| 79 | [jev-local Qwen3.5-9B](https://modelscale.dev/models/jev-local) | us (GitHub) | 32.54 | Observed 2026-10-23 · source benchlm:models |
| 81 | [Decision Fast (FlyMy.AI, v53a)](https://modelscale.dev/models/jevbench-decision-fast) | FlyMy.AI (@denti) | 32.49 | Last good 2026-10-01 · source benchlm:models |
| 81 | [Decision Fast v53a](https://modelscale.dev/models/decision-fast) | FlyMy.AI | 32.49 | Observed 2026-10-23 · source benchlm:models |
| 83 | [decider-2b](https://modelscale.dev/models/decider-2b) | Mapika | 30.74 | Observed 2026-10-23 · source benchlm:models |
| 83 | [decider-2b (Mapika)](https://modelscale.dev/models/jevbench-decider-2b) | Mapika | 30.74 | Last good 2026-10-01 · source benchlm:models |
| 85 | [jeff](https://modelscale.dev/models/jeff) | Logan Markewich | 30.58 | Observed 2026-10-23 · source benchlm:models |
| 85 | [jeff (Logan Markewich, GLiFormer 400M)](https://modelscale.dev/models/jevbench-jeff) | Logan Markewich | 30.58 | Last good 2026-10-01 · source benchlm:models |
| 87 | [Laya](https://modelscale.dev/models/laya) | Convai Innovations | 30.25 | Observed 2026-10-23 · source benchlm:models |
| 87 | [Laya (Convai Innovations, ModernBERT-large 421M)](https://modelscale.dev/models/jevbench-laya) | Convai Innovations | 30.25 | Last good 2026-10-01 · source benchlm:models |
| 89 | [Autoloops – Gemma 4 31B IT](https://modelscale.dev/models/jevbench-kushal-gemma4-31b-it-autoloops) | Autoloops | 29.96 | Last good 2026-10-01 · source benchlm:models |
| 89 | [Autoloops Gemma 4 31B IT](https://modelscale.dev/models/autoloops-gemma-4-31b-it) | Autoloops | 29.96 | Observed 2026-10-23 · source benchlm:models |
| 91 | [Standard One 8B](https://modelscale.dev/models/standardone-8b) | Standard Thinking | 29.07 | Observed 2026-10-23 · source benchlm:models |
| 91 | [Standard One 8B (Standard Thinking)](https://modelscale.dev/models/jevbench-standardone-8b) | Standard Thinking (myeongho12) | 29.07 | Last good 2026-10-01 · source benchlm:models |
| 93 | [lev-350m](https://modelscale.dev/models/lev-350m) | Franck Verrot (franckverrot) | 28.50 | Observed 2026-10-23 · source benchlm:models |
| 93 | [lev-350m (Franck Verrot, LFM2.5-350M)](https://modelscale.dev/models/jevbench-lev-350m) | Franck Verrot (franckverrot) | 28.50 | Last good 2026-10-01 · source benchlm:models |
| 95 | [openjev-sglang (Qwen3.6-35B-A3B on SGLang)](https://modelscale.dev/models/jevbench-openjev-sglang) | ekzhang | 27.65 | Last good 2026-10-01 · source benchlm:models |
| 95 | [openjev-sglang Qwen3.6-35B-A3B](https://modelscale.dev/models/openjev-sglang) | ekzhang | 27.65 | Observed 2026-10-23 · source benchlm:models |
| 97 | [Von (wfzyx, Option-Marker 395M)](https://modelscale.dev/models/jevbench-von-395m) | wfzyx (Victor Hugo) | 27.48 | Last good 2026-10-01 · source benchlm:models |
| 97 | [Von 395M](https://modelscale.dev/models/von-395m) | wfzyx (Victor Hugo) | 27.48 | Observed 2026-10-23 · source benchlm:models |
| 99 | [NInfer Qwen3.8-27B NVFP4 (T=1.5)](https://modelscale.dev/models/jevbench-ninfer-qwen3-8-27b-t1-5) | Igor L. / NInfer contributors | 26.92 | Last good 2026-10-01 · source benchlm:models |
| 99 | [NInfer Qwen3.8-27B NVFP4 (T=1.5)](https://modelscale.dev/models/ninfer-qwen3-8-27b-t1-5) | Igor L. / NInfer contributors | 26.92 | Observed 2026-10-23 · source benchlm:models |
| 101 | [NInfer Qwen3.8-27B NVFP4](https://modelscale.dev/models/jevbench-ninfer-qwen3-8-27b) | Igor L. / NInfer contributors | 26.30 | Last good 2026-10-01 · source benchlm:models |
| 101 | [NInfer Qwen3.8-27B NVFP4](https://modelscale.dev/models/ninfer-qwen3-8-27b) | Igor L. / NInfer contributors | 26.30 | Observed 2026-10-23 · source benchlm:models |
| 103 | [kev 8B](https://modelscale.dev/models/kev-8b) | Jared Palmer | 25.56 | Observed 2026-10-23 · source benchlm:models |
| 103 | [kev 8B (research preview)](https://modelscale.dev/models/jevbench-kev-8b) | Jared Palmer | 25.56 | Last good 2026-10-01 · source benchlm:models |
| 105 | [JevOne](https://modelscale.dev/models/jevbench-jevone) | Juspay | 25.51 | Last good 2026-10-01 · source benchlm:models |
| 105 | [JevOne](https://modelscale.dev/models/jevone) | Juspay | 25.51 | Observed 2026-10-23 · source benchlm:models |
| 107 | [typecastlm](https://modelscale.dev/models/typecastlm) | Mikhail Gribov | 25.28 | Observed 2026-10-23 · source benchlm:models |
| 107 | [typecastlm (Mikhail Gribov, Qwen3.5-4B computed head)](https://modelscale.dev/models/jevbench-typecastlm) | Mikhail Gribov | 25.28 | Last good 2026-10-01 · source benchlm:models |
| 109 | [SimpleJev Qwen3.6-35B-A3B](https://modelscale.dev/models/jevbench-simplejev-qwen3-6-35b-a3b) | Featherless AI | 24.86 | Last good 2026-10-01 · source benchlm:models |
| 109 | [SimpleJev Qwen3.6-35B-A3B](https://modelscale.dev/models/simplejev-qwen3-6-35b-a3b) | Featherless AI | 24.86 | Observed 2026-10-23 · source benchlm:models |
| 111 | [kev 0.6B](https://modelscale.dev/models/kev-0-6b) | Jared Palmer | 24.75 | Observed 2026-10-23 · source benchlm:models |
| 111 | [kev 0.6B (research preview)](https://modelscale.dev/models/jevbench-kev-0-6b) | Jared Palmer | 24.75 | Last good 2026-10-01 · source benchlm:models |
| 113 | [Raw Qwen3 8B direct logits](https://modelscale.dev/models/jevbench-raw-qwen3-8b) | Alibaba Qwen / neutral reproduction | 23.68 | Last good 2026-10-01 · source benchlm:models |
| 113 | [Raw Qwen3 8B direct logits](https://modelscale.dev/models/raw-qwen3-8b) | Alibaba | 23.68 | Observed 2026-10-23 · source benchlm:models |
| 115 | [system-one (Qwen3-8B, Sean Goedecke)](https://modelscale.dev/models/jevbench-system-one-sg) | Sean Goedecke | 23.37 | Last good 2026-10-01 · source benchlm:models |
| 115 | [system-one Qwen3-8B](https://modelscale.dev/models/system-one-sg) | Sean Goedecke | 23.37 | Observed 2026-10-23 · source benchlm:models |
| 117 | [OpenDecision (ModernBERT-large zero-shot)](https://modelscale.dev/models/jevbench-opendecision) | Deepan Wadhwa | 21.64 | Last good 2026-10-01 · source benchlm:models |
| 117 | [OpenDecision ModernBERT-large](https://modelscale.dev/models/opendecision) | Deepan Wadhwa | 21.64 | Observed 2026-10-23 · source benchlm:models |
| 119 | [LitJev (Qwen3.8-27B)](https://modelscale.dev/models/jevbench-litjev) | Zhengxu Yu | 19.51 | Last good 2026-10-01 · source benchlm:models |
| 119 | [LitJev Qwen3.8-27B](https://modelscale.dev/models/litjev) | Zhengxu Yu | 19.51 | Observed 2026-10-23 · source benchlm:models |
| 121 | [openJev Verdict 1.4](https://modelscale.dev/models/jevbench-openjev-verdict-1-4) | Hemant (heman10x) | 19.00 | Last good 2026-10-01 · source benchlm:models |
| 121 | [openJev Verdict 1.4](https://modelscale.dev/models/openjev-verdict-1-4) | Hemant (heman10x) | 19.00 | Observed 2026-10-23 · source benchlm:models |
| 123 | [kev 0.5B](https://modelscale.dev/models/jevbench-kev-0-5b) | Jared Palmer | 18.88 | Last good 2026-10-01 · source benchlm:models |
| 123 | [kev 0.5B](https://modelscale.dev/models/kev-0-5b) | Jared Palmer | 18.88 | Observed 2026-10-23 · source benchlm:models |
| 125 | [Bespoke Nimble 9B](https://modelscale.dev/models/nimble-9b) | Bespoke Labs | 18.66 | Observed 2026-10-23 · source benchlm:models |
| 125 | [Bespoke Nimble 9B (Bespoke Labs)](https://modelscale.dev/models/jevbench-nimble-9b) | Bespoke Labs | 18.66 | Last good 2026-10-01 · source benchlm:models |
| 127 | [GPT-5.6 Luna (low reasoning effort)](https://modelscale.dev/models/jevbench-gpt-5-6-luna) | OpenAI | 18.51 | Last good 2026-10-01 · source benchlm:models |
| 127 | [GPT-5.6 Luna (low)](https://modelscale.dev/models/gpt-5-6-luna-low) | OpenAI | 18.51 | Observed 2026-10-23 · source benchlm:models |
| 129 | [openJev Verdict](https://modelscale.dev/models/openjev-verdict) | Hemant (heman10x) | 18.09 | Observed 2026-10-23 · source benchlm:models |
| 129 | [openJev Verdict (heman10x, ModernBERT-base 151M)](https://modelscale.dev/models/jevbench-openjev-verdict) | Hemant (heman10x) | 18.09 | Last good 2026-10-01 · source benchlm:models |
| 131 | [Raw Qwen3 1.7B direct logits](https://modelscale.dev/models/jevbench-raw-qwen3-1-7b) | Alibaba Qwen / neutral reproduction | 18.06 | Last good 2026-10-01 · source benchlm:models |
| 131 | [Raw Qwen3 1.7B direct logits](https://modelscale.dev/models/raw-qwen3-1-7b) | Alibaba | 18.06 | Observed 2026-10-23 · source benchlm:models |
| 133 | [reflex-27b](https://modelscale.dev/models/reflex-27b) | kshetrajna12 | 17.84 | Observed 2026-10-23 · source benchlm:models |
| 133 | [reflex-27b (Qwen3.8-27B)](https://modelscale.dev/models/jevbench-reflex-27b) | kshetrajna12 | 17.84 | Last good 2026-10-01 · source benchlm:models |
| 135 | [JevAct](https://modelscale.dev/models/jevact) | einptein | 16.93 | Observed 2026-10-23 · source benchlm:models |
| 135 | [JevAct (einptein, jev1-2b-v2)](https://modelscale.dev/models/jevbench-jevact) | einptein | 16.93 | Last good 2026-10-01 · source benchlm:models |
| 137 | [djev (thinking)](https://modelscale.dev/models/djev-thinking) | Maisa | 15.20 | Observed 2026-10-23 · source benchlm:models |
| 137 | [djev (thinking)](https://modelscale.dev/models/jevbench-djev-thinking) | David Villalon / Maisa | 15.20 | Last good 2026-10-01 · source benchlm:models |
| 139 | [GLiNER2 large](https://modelscale.dev/models/gliner2-large) | Fastino | 15.14 | Observed 2026-10-23 · source benchlm:models |
| 139 | [GLiNER2 large (Fastino)](https://modelscale.dev/models/jevbench-gliner2-large) | Fastino | 15.14 | Last good 2026-10-01 · source benchlm:models |
| 141 | [OpenJev (thinking, BF16)](https://modelscale.dev/models/jevbench-openjev-thinking) | razorback16 | 14.83 | Last good 2026-10-01 · source benchlm:models |
| 141 | [OpenJev (thinking, BF16)](https://modelscale.dev/models/openjev-thinking) | razorback16 | 14.83 | Observed 2026-10-23 · source benchlm:models |
| 143 | [Qwen3.5-0.8B Decision Model](https://modelscale.dev/models/mghafiri-qwen3-5-0-8b-decision-model) | Mourad Ghafiri | 14.54 | Observed 2026-10-23 · source benchlm:models |
| 143 | [Qwen3.5-0.8B Decision Model (Mourad Ghafiri)](https://modelscale.dev/models/jevbench-mghafiri-qwen3-5-0-8b-decision-model) | Mourad Ghafiri | 14.54 | Last good 2026-10-01 · source benchlm:models |
| 145 | [Gemini 3.1 Flash-Lite](https://modelscale.dev/models/gemini-3-1-flash-lite) | Google | 14.26 | Observed 2026-10-23 · source benchlm:models |
| 146 | [open-jev-deberta-v3-large](https://modelscale.dev/models/open-jev-deberta-v3-large) | Kotoba Labs | 12.65 | Observed 2026-10-23 · source benchlm:models |
| 146 | [open-jev-deberta-v3-large (local CPU)](https://modelscale.dev/models/jevbench-open-jev-deberta-v3-large) | Kotoba Labs | 12.65 | Last good 2026-10-01 · source benchlm:models |
| 148 | [smalljev semantic-v9](https://modelscale.dev/models/jevbench-smalljev) | Aditya (isHeSatoshi) | 12.31 | Last good 2026-10-01 · source benchlm:models |
| 148 | [smalljev semantic-v9](https://modelscale.dev/models/smalljev) | Aditya (isHeSatoshi) | 12.31 | Observed 2026-10-23 · source benchlm:models |
| 150 | [GLiNER2 (Fastino, gliner2.5-base)](https://modelscale.dev/models/jevbench-gliner2) | Fastino | 11.78 | Last good 2026-10-01 · source benchlm:models |
| 150 | [GLiNER2.5 base](https://modelscale.dev/models/gliner2-5-base) | Fastino | 11.78 | Observed 2026-10-23 · source benchlm:models |
| 152 | [Instinct (ZooWork, Qwen3.8-27B)](https://modelscale.dev/models/jevbench-instinct) | rayrain-srp (ZooWork) | 11.45 | Last good 2026-10-01 · source benchlm:models |
| 152 | [Instinct Qwen3.8-27B](https://modelscale.dev/models/instinct) | ZooWork | 11.45 | Observed 2026-10-23 · source benchlm:models |
| 154 | [Open-Jev 9B](https://modelscale.dev/models/open-jev-zefan-9b) | Zefan Cai (@Zefan_Cai) | 11.20 | Observed 2026-10-23 · source benchlm:models |
| 154 | [Open-Jev 9B (Zefan Cai)](https://modelscale.dev/models/jevbench-open-jev-zefan-9b) | Zefan Cai (@Zefan_Cai) | 11.20 | Last good 2026-10-01 · source benchlm:models |
| 156 | [Open-Jev 2B](https://modelscale.dev/models/open-jev-zefan-2b) | Zefan Cai (@Zefan_Cai) | 9.98 | Observed 2026-10-23 · source benchlm:models |
| 156 | [Open-Jev 2B (Zefan Cai)](https://modelscale.dev/models/jevbench-open-jev-zefan-2b) | Zefan Cai (@Zefan_Cai) | 9.98 | Last good 2026-10-01 · source benchlm:models |
| 158 | [GLiNER2.5 multi](https://modelscale.dev/models/gliner2-5-multi) | Fastino | 9.76 | Observed 2026-10-23 · source benchlm:models |
| 158 | [GLiNER2.5 multi (Fastino, 287M)](https://modelscale.dev/models/jevbench-gliner2-5-multi) | Fastino | 9.76 | Last good 2026-10-01 · source benchlm:models |
| 160 | [CLM-8B](https://modelscale.dev/models/clm-8b) | Contrastive-LM | 8.57 | Observed 2026-10-23 · source benchlm:models |
| 160 | [CLM-8B (Contrastive-LM, clm-latest)](https://modelscale.dev/models/jevbench-clm-8b) | Contrastive-LM (Kwok, Kang, Suresh, Saad-Falcon, Pavone, Ré, Mirhoseini) | 8.57 | Last good 2026-10-01 · source benchlm:models |
| 162 | [SimpleJev (Qwen3.5-0.8B, CPU)](https://modelscale.dev/models/jevbench-simplejev-qwen3-5-0-8b) | sabeel111 / Featherless AI | 7.46 | Last good 2026-10-01 · source benchlm:models |
| 162 | [SimpleJev Qwen3.5-0.8B](https://modelscale.dev/models/simplejev-qwen3-5-0-8b) | Featherless AI | 7.46 | Observed 2026-10-23 · source benchlm:models |
| 164 | [GLiNER2.5 small](https://modelscale.dev/models/gliner2-5-small) | Fastino | 7.19 | Observed 2026-10-23 · source benchlm:models |
| 164 | [GLiNER2.5 small (Fastino, 74M)](https://modelscale.dev/models/jevbench-gliner2-5-small) | Fastino | 7.19 | Last good 2026-10-01 · source benchlm:models |
| 166 | [Raw Qwen3 0.6B direct logits](https://modelscale.dev/models/jevbench-raw-qwen3-0-6b) | Alibaba Qwen / neutral reproduction | 7.14 | Last good 2026-10-01 · source benchlm:models |
| 166 | [Raw Qwen3 0.6B direct logits](https://modelscale.dev/models/raw-qwen3-0-6b) | Alibaba | 7.14 | Observed 2026-10-23 · source benchlm:models |
| 168 | [verdict-small](https://modelscale.dev/models/verdict-small) | Manavarya09 (Manav) | 5.69 | Observed 2026-10-23 · source benchlm:models |
| 168 | [verdict-small (Manavarya09, multilingual-e5-small 118M)](https://modelscale.dev/models/jevbench-verdict-small) | Manavarya09 (Manav) | 5.69 | Last good 2026-10-01 · source benchlm:models |
| 170 | [DeepSeek V4.1 Flash 1017](https://modelscale.dev/models/deepseek-v4-1-flash) | DeepSeek | 4.77 | Observed 2026-10-23 · source benchlm:models |
| 171 | [Mirror](https://modelscale.dev/models/jevbench-mirror) | Bluusun | 2.11 | Last good 2026-10-01 · source benchlm:models |
| 171 | [Mirror](https://modelscale.dev/models/mirror) | Bluusun | 2.11 | Observed 2026-10-23 · source benchlm:models |
| 173 | [Mixedbread mxbai-rerank-base-v2](https://modelscale.dev/models/jevbench-mxbai-rerank-base-v2) | Mixedbread | 0.40 | Last good 2026-10-01 · source benchlm:models |
| 173 | [Mixedbread mxbai-rerank-base-v2](https://modelscale.dev/models/mxbai-rerank-base-v2) | Mixedbread | 0.40 | Observed 2026-10-23 · source benchlm:models |
| 175 | [BAAI bge-reranker-v2-m3](https://modelscale.dev/models/bge-reranker-v2-m3) | BAAI | 0.17 | Observed 2026-10-23 · source benchlm:models |
| 175 | [BAAI bge-reranker-v2-m3](https://modelscale.dev/models/jevbench-bge-reranker-v2-m3) | BAAI | 0.17 | Last good 2026-10-01 · source benchlm:models |
| 177 | [Alibaba GTE Reranker ModernBERT-base](https://modelscale.dev/models/gte-reranker-modernbert-base) | Alibaba | 0.15 | Observed 2026-10-23 · source benchlm:models |
| 177 | [Alibaba GTE Reranker ModernBERT-base](https://modelscale.dev/models/jevbench-gte-reranker-modernbert-base) | Alibaba-NLP | 0.15 | Last good 2026-10-01 · source benchlm:models |
| 179 | [Certo v1](https://modelscale.dev/models/certo) | AltSlate Labs | 0.00 | Observed 2026-10-23 · source benchlm:models |
| 179 | [Certo v1 (AltSlate Labs)](https://modelscale.dev/models/jevbench-certo) | AltSlate Labs | 0.00 | Last good 2026-10-01 · source benchlm:models |
| 181 | [Open Jev JSON Canvas](https://modelscale.dev/models/open-jev-json-canvas-joshuasp) | JoshuaSP | 0.00 | Observed 2026-10-23 · source benchlm:models |
| 181 | [Open Jev JSON Canvas (JoshuaSP)](https://modelscale.dev/models/jevbench-open-jev-json-canvas-joshuasp) | JoshuaSP | 0.00 | Last good 2026-10-01 · source benchlm:models |
| 181 | [Qwen3.8 27B (Chutes TEE)](https://modelscale.dev/models/jevbench-qwen3-8-27b) | Qwen / Chutes | 0.00 | Last good 2026-10-01 · source benchlm:models |
| 181 | [Qwen3.8-27B (Chutes TEE)](https://modelscale.dev/models/qwen3-8-27b-chutes) | Alibaba | 0.00 | Observed 2026-10-23 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.