Loading page…
Preferred languages
More languages supported by Google Translate
Open the selector to load the current language catalog.
Translations are provided by Google Translate.
Loading page…
Preferred languages
More languages supported by Google Translate
Open the selector to load the current language catalog.
Translations are provided by Google Translate.
Reasoning benchmark
Every model the catalog carries a published JevBench 1.4 value for, ranked by that value.
Decision-system evaluation combining chance-corrected intelligence, probability calibration, latency, and cost across 842 decisions.
184 models with a published JevBench 1.4 value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.
| Rank | Model | Provider | Equal-weight harmonic composite with gates |
|---|---|---|---|
| 1 | M(classifier.dev (fast tier) | mrmps (@michael_chomsky) | 70.82 |
| 1 | CDclassifier.dev (fast) | classifier.dev | 70.82 |
| 3 | MOImajev-4B | mohit67890 | 67.37 |
What the benchmark measures and how its value is published, from the source’s own record.
JevBench 1.4 is a reasoning benchmark published by JevBench v1.4 method. Decision-system evaluation combining chance-corrected intelligence, probability calibration, latency, and cost across 842 decisions. Its evaluation set is described by the source as 534 frozen v1.2 decisions plus 308 sealed v1.4 decisions. The source rates its difficulty as typed decisions with sealed generalization tests.
Each model's result is published by JevBench v1.4 method as equal-weight harmonic composite with gates. ModelScale prints that value to 2 decimal places, exactly as published, and never converts or rescales it. This page ranks the 184 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.
| 3 | MOImajev-4B | mohit67890 | 67.37 |
| 5 | CRPlumb-4B | crh225 | 65.84 |
| 5 | CRPlumb-4B (crh225, JevK5 v0.2 + LoRA) | crh225 | 65.84 |
| 7 | MAdecider-4b v2 | Mapika | 64.13 |
| 7 | MAdecider-4b v2 (Mapika) | Mapika | 64.13 |
| 9 | TAJev 1.13.0 | TypeSafe AI | 63.29 |
| 9 | TAJev 1.13.0 (TypeSafe AI) | TypeSafe AI | 63.29 |
| 11 | ALJevK5 v0.2.0 | allebee | 62.04 |
| 11 | ALJevK5 v0.2.0 | allebee | 62.04 |
| 13 | BLCygnet | blockbrain | 61.76 |
| 13 | BLCygnet (blockbrain, frozen Gemma-4-12B-it) | blockbrain | 61.76 |
| 15 | HOHopper | HopitAI | 59.43 |
| 15 | HOHopper | HopitAI | 59.43 |
| 17 | ERWinnow-12B Q8 | Eldan Ring | 55.58 |
| 17 | ERWinnow-12B Q8 | Eldan Ring | 55.58 |
| 19 | KSreflex 4B | kshetrajna12 | 53.99 |
| 19 | KSreflex 4B (kshetrajna12) | kshetrajna12 | 53.99 |
| 21 | MAdjev | Maisa | 52.23 |
| 21 | M(djev (Maisa, diffusion-gemma) | Maisa (David Villalón) | 52.23 |
| 23 | AKJev-Omni | akhilaaa3 | 51.34 |
| 23 | AKJev-Omni (akhilaaa3, Gemma-4-12B merged) | akhilaaa3 | 51.34 |
| 25 | W(metask-jev-4b | Wayfind (metask-ai) | 47.78 |
| 25 | W(metask-jev-4b | Wayfind (metask-ai) | 47.78 |
| 27 | TLSemIf Qwen3.5-4B | Theodore Lee (TheoLeeCJ) | 47.69 |
| 27 | TLSemIf, formerly OpenJev (Qwen3.5-4B, TheoLeeCJ) | Theodore Lee (TheoLeeCJ) | 47.69 |
| 29 | MAJobe Qwen3.5-4B | MantisShrimpdev | 46.94 |
| 29 | MAJobe Qwen3.5-4B (frozen) | MantisShrimpdev | 46.94 |
| 31 | AClocal-jev Qwen3.5-4B | Amith Chandrappa (amithgc) | 46.80 |
| 31 | AClocal-jev Qwen3.5-4B | Amith Chandrappa (amithgc) | 46.80 |
| 33 | MIsystem-one-open | mithalouni | 45.11 |
| 33 | MIsystem-one-open (Gemma 4 E2B LoRA on an L4) | mithalouni | 45.11 |
| 35 | ARspark-s1-4b-v6 | Abhishek Rai (abhishek085) | 44.62 |
| 35 | ARspark-s1-4b-v6 (Open Spark Jev, abhishek085) | Abhishek Rai (abhishek085) | 44.62 |
| 37 | N(Malkuth-4B | newfull5 (dhtocks) | 44.45 |
| 37 | N(Malkuth-4B (newfull5, Kev post-train) | newfull5 (dhtocks) | 44.45 |
| 39 | H(jqv (Qwen3-32B zero-shot) | hjmurmur (Octalab) | 44.35 |
| 39 | OCjqv Qwen3-32B | Octalab | 44.35 |
| 41 | Qwen | 43.49 |
| 41 | Alibaba | 43.49 |
| 43 | MAdecider-35b-a3b | Mapika | 41.18 |
| 43 | MAdecider-35b-a3b (Mapika) | Mapika | 41.18 |
| 45 | AQRaw Qwen3 4B Instruct 2507 direct logits | Alibaba Qwen / neutral reproduction | 40.95 |
| 45 | Alibaba | 40.95 |
| 47 | SAOpenSourceJev (Qwen3.5-4B Q4_K_M, native llama.cpp) | sabeel111 | 40.87 |
| 47 | SAOpenSourceJev Qwen3.5-4B Q4_K_M | sabeel111 | 40.87 |
| 49 | ZEZeroEntropy zerank-2 | ZeroEntropy | 40.21 |
| 49 | ZEZeroEntropy zerank-2 | ZeroEntropy | 40.21 |
| 51 | MAdecision-machine-1 | milliseconds.ai | 39.94 |
| 51 | MAdecision-machine-1 (milliseconds.ai) | milliseconds.ai (Baptiste Laget) | 39.94 |
| 53 | N(Malkuth-2B | newfull5 (dhtocks) | 38.93 |
| 53 | N(Malkuth-2B (newfull5, Kev post-train) | newfull5 (dhtocks) | 38.93 |
| 55 | MNRaw Phi-4 mini direct logits | Microsoft / neutral reproduction | 37.96 |
| 55 | Microsoft | 37.96 |
| 57 | WIJEV Qwen3.5-9B Base NVFP4 | WilfLin | 37.70 |
| 57 | WIJEV Qwen3.5-9B Base NVFP4 | WilfLin | 37.70 |
| 59 | RCOpenJev (DiffusionGemma 26B-A4B NVFP4, razorback16) | razorback16 / Codiv | 36.85 |
| 59 | RCOpenJev DiffusionGemma 26B-A4B NVFP4 | razorback16 / Codiv | 36.85 |
| 61 | JPkev 4B | Jared Palmer | 36.14 |
| 61 | JPkev 4B (research preview) | Jared Palmer | 36.14 |
| 63 | FADecision 2B (FlyMy.AI, v59) | FlyMy.AI (@denti) | 35.80 |
| 63 | FADecision 2B v59 | FlyMy.AI | 35.80 |
| 65 | JSQwen3.5-9B Jev-like data-mix v2 | jsaurabh | 35.24 |
| 65 | JSQwen3.5-9B Jev-like data-mix v2 | jsaurabh | 35.24 |
| 67 | OpenAI | 35.11 |
| 67 | OpenAI | 35.11 |
| 69 | FASimpleJev Qwen3.8-27B | Featherless AI | 34.57 |
| 69 | FASimpleJev Qwen3.8-27B | Featherless AI | 34.57 |
| 71 | ILNInfer Qwen3.8-Flash-Next mixed | Igor L. / NInfer contributors | 33.98 |
| 71 | ILNInfer Qwen3.8-Flash-Next mixed | Igor L. / NInfer contributors | 33.98 |
| 73 | BLswanOne | blockbrain | 33.61 |
| 73 | BLswanOne (blockbrain, Qwen3.8-Flash-Next NVFP4) | blockbrain | 33.61 |
| 75 | OpenAI | 33.27 |
| 75 | OpenAI | 33.27 |
| 77 | IKopen-alternative-jev (Qwen3.5-4B, IkerMoel) | IkerMoel | 33.24 |
| 77 | IKopen-alternative-jev Qwen3.5-4B | IkerMoel | 33.24 |
| 79 | U(jev-local (Qwen3.5-9B) | us (GitHub) | 32.54 |
| 79 | U(jev-local Qwen3.5-9B | us (GitHub) | 32.54 |
| 81 | FADecision Fast (FlyMy.AI, v53a) | FlyMy.AI (@denti) | 32.49 |
| 81 | FADecision Fast v53a | FlyMy.AI | 32.49 |
| 83 | MAdecider-2b | Mapika | 30.74 |
| 83 | MAdecider-2b (Mapika) | Mapika | 30.74 |
| 85 | LMjeff | Logan Markewich | 30.58 |
| 85 | LMjeff (Logan Markewich, GLiFormer 400M) | Logan Markewich | 30.58 |
| 87 | CILaya | Convai Innovations | 30.25 |
| 87 | CILaya (Convai Innovations, ModernBERT-large 421M) | Convai Innovations | 30.25 |
| 89 | AUAutoloops – Gemma 4 31B IT | Autoloops | 29.96 |
| 89 | AUAutoloops Gemma 4 31B IT | Autoloops | 29.96 |
| 91 | STStandard One 8B | Standard Thinking | 29.07 |
| 91 | STStandard One 8B (Standard Thinking) | Standard Thinking (myeongho12) | 29.07 |
| 93 | FVlev-350m | Franck Verrot (franckverrot) | 28.50 |
| 93 | FVlev-350m (Franck Verrot, LFM2.5-350M) | Franck Verrot (franckverrot) | 28.50 |
| 95 | EKopenjev-sglang (Qwen3.6-35B-A3B on SGLang) | ekzhang | 27.65 |
| 95 | EKopenjev-sglang Qwen3.6-35B-A3B | ekzhang | 27.65 |
| 97 | W(Von (wfzyx, Option-Marker 395M) | wfzyx (Victor Hugo) | 27.48 |
| 97 | W(Von 395M | wfzyx (Victor Hugo) | 27.48 |
| 99 | ILNInfer Qwen3.8-27B NVFP4 (T=1.5) | Igor L. / NInfer contributors | 26.92 |
| 99 | ILNInfer Qwen3.8-27B NVFP4 (T=1.5) | Igor L. / NInfer contributors | 26.92 |
| 101 | ILNInfer Qwen3.8-27B NVFP4 | Igor L. / NInfer contributors | 26.30 |
| 101 | ILNInfer Qwen3.8-27B NVFP4 | Igor L. / NInfer contributors | 26.30 |
| 103 | JPkev 8B | Jared Palmer | 25.56 |
| 103 | JPkev 8B (research preview) | Jared Palmer | 25.56 |
| 105 | JUJevOne | Juspay | 25.51 |
| 105 | JUJevOne | Juspay | 25.51 |
| 107 | MGtypecastlm | Mikhail Gribov | 25.28 |
| 107 | MGtypecastlm (Mikhail Gribov, Qwen3.5-4B computed head) | Mikhail Gribov | 25.28 |
| 109 | FASimpleJev Qwen3.6-35B-A3B | Featherless AI | 24.86 |
| 109 | FASimpleJev Qwen3.6-35B-A3B | Featherless AI | 24.86 |
| 111 | JPkev 0.6B | Jared Palmer | 24.75 |
| 111 | JPkev 0.6B (research preview) | Jared Palmer | 24.75 |
| 113 | AQRaw Qwen3 8B direct logits | Alibaba Qwen / neutral reproduction | 23.68 |
| 113 | Alibaba | 23.68 |
| 115 | SGsystem-one (Qwen3-8B, Sean Goedecke) | Sean Goedecke | 23.37 |
| 115 | SGsystem-one Qwen3-8B | Sean Goedecke | 23.37 |
| 117 | DWOpenDecision (ModernBERT-large zero-shot) | Deepan Wadhwa | 21.64 |
| 117 | DWOpenDecision ModernBERT-large | Deepan Wadhwa | 21.64 |
| 119 | ZYLitJev (Qwen3.8-27B) | Zhengxu Yu | 19.51 |
| 119 | ZYLitJev Qwen3.8-27B | Zhengxu Yu | 19.51 |
| 121 | H(openJev Verdict 1.4 | Hemant (heman10x) | 19.00 |
| 121 | H(openJev Verdict 1.4 | Hemant (heman10x) | 19.00 |
| 123 | JPkev 0.5B | Jared Palmer | 18.88 |
| 123 | JPkev 0.5B | Jared Palmer | 18.88 |
| 125 | BLBespoke Nimble 9B | Bespoke Labs | 18.66 |
| 125 | BLBespoke Nimble 9B (Bespoke Labs) | Bespoke Labs | 18.66 |
| 127 | OpenAI | 18.51 |
| 127 | OpenAI | 18.51 |
| 129 | H(openJev Verdict | Hemant (heman10x) | 18.09 |
| 129 | H(openJev Verdict (heman10x, ModernBERT-base 151M) | Hemant (heman10x) | 18.09 |
| 131 | AQRaw Qwen3 1.7B direct logits | Alibaba Qwen / neutral reproduction | 18.06 |
| 131 | Alibaba | 18.06 |
| 133 | KSreflex-27b | kshetrajna12 | 17.84 |
| 133 | KSreflex-27b (Qwen3.8-27B) | kshetrajna12 | 17.84 |
| 135 | EIJevAct | einptein | 16.93 |
| 135 | EIJevAct (einptein, jev1-2b-v2) | einptein | 16.93 |
| 137 | MAdjev (thinking) | Maisa | 15.20 |
| 137 | DVdjev (thinking) | David Villalon / Maisa | 15.20 |
| 139 | FAGLiNER2 large | Fastino | 15.14 |
| 139 | FAGLiNER2 large (Fastino) | Fastino | 15.14 |
| 141 | RAOpenJev (thinking, BF16) | razorback16 | 14.83 |
| 141 | RAOpenJev (thinking, BF16) | razorback16 | 14.83 |
| 143 | MGQwen3.5-0.8B Decision Model | Mourad Ghafiri | 14.54 |
| 143 | MGQwen3.5-0.8B Decision Model (Mourad Ghafiri) | Mourad Ghafiri | 14.54 |
| 145 | 14.26 |
| 146 | KLopen-jev-deberta-v3-large | Kotoba Labs | 12.65 |
| 146 | KLopen-jev-deberta-v3-large (local CPU) | Kotoba Labs | 12.65 |
| 148 | A(smalljev semantic-v9 | Aditya (isHeSatoshi) | 12.31 |
| 148 | A(smalljev semantic-v9 | Aditya (isHeSatoshi) | 12.31 |
| 150 | FAGLiNER2 (Fastino, gliner2.5-base) | Fastino | 11.78 |
| 150 | FAGLiNER2.5 base | Fastino | 11.78 |
| 152 | RSInstinct (ZooWork, Qwen3.8-27B) | rayrain-srp (ZooWork) | 11.45 |
| 152 | ZOInstinct Qwen3.8-27B | ZooWork | 11.45 |
| 154 | ZCOpen-Jev 9B | Zefan Cai (@Zefan_Cai) | 11.20 |
| 154 | ZCOpen-Jev 9B (Zefan Cai) | Zefan Cai (@Zefan_Cai) | 11.20 |
| 156 | ZCOpen-Jev 2B | Zefan Cai (@Zefan_Cai) | 9.98 |
| 156 | ZCOpen-Jev 2B (Zefan Cai) | Zefan Cai (@Zefan_Cai) | 9.98 |
| 158 | FAGLiNER2.5 multi | Fastino | 9.76 |
| 158 | FAGLiNER2.5 multi (Fastino, 287M) | Fastino | 9.76 |
| 160 | CLCLM-8B | Contrastive-LM | 8.57 |
| 160 | CLCLM-8B (Contrastive-LM, clm-latest) | Contrastive-LM (Kwok, Kang, Suresh, Saad-Falcon, Pavone, Ré, Mirhoseini) | 8.57 |
| 162 | SFSimpleJev (Qwen3.5-0.8B, CPU) | sabeel111 / Featherless AI | 7.46 |
| 162 | FASimpleJev Qwen3.5-0.8B | Featherless AI | 7.46 |
| 164 | FAGLiNER2.5 small | Fastino | 7.19 |
| 164 | FAGLiNER2.5 small (Fastino, 74M) | Fastino | 7.19 |
| 166 | AQRaw Qwen3 0.6B direct logits | Alibaba Qwen / neutral reproduction | 7.14 |
| 166 | Alibaba | 7.14 |
| 168 | M(verdict-small | Manavarya09 (Manav) | 5.69 |
| 168 | M(verdict-small (Manavarya09, multilingual-e5-small 118M) | Manavarya09 (Manav) | 5.69 |
| 170 | DeepSeek | 4.77 |
| 171 | BLMirror | Bluusun | 2.11 |
| 171 | BLMirror | Bluusun | 2.11 |
| 173 | MIMixedbread mxbai-rerank-base-v2 | Mixedbread | 0.40 |
| 173 | MIMixedbread mxbai-rerank-base-v2 | Mixedbread | 0.40 |
| 175 | BABAAI bge-reranker-v2-m3 | BAAI | 0.17 |
| 175 | BABAAI bge-reranker-v2-m3 | BAAI | 0.17 |
| 177 | Alibaba | 0.15 |
| 177 | ANAlibaba GTE Reranker ModernBERT-base | Alibaba-NLP | 0.15 |
| 179 | ALCerto v1 | AltSlate Labs | 0.00 |
| 179 | ALCerto v1 (AltSlate Labs) | AltSlate Labs | 0.00 |
| 181 | JOOpen Jev JSON Canvas | JoshuaSP | 0.00 |
| 181 | JOOpen Jev JSON Canvas (JoshuaSP) | JoshuaSP | 0.00 |
| 181 | QCQwen3.8 27B (Chutes TEE) | Qwen / Chutes | 0.00 |
| 181 | Alibaba | 0.00 |
Evidence key: ObservedLast good
Rows are ordered by the value JevBench v1.4 method published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.