Categoryexternal
MeasureChance-corrected area score
TasksKnowledge area of the Decision Index evaluation
DifficultyKnowledge decision tasks
Decision Index 0.4 publishes chance-corrected knowledge scores for 209 evaluated systems.
Decision Index Knowledge ranking
120 models with a published Decision Index Knowledge value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.
Models ranked by their published Decision Index 0.4 Knowledge value| Rank | Model | Provider | Chance-corrected area score |
|---|
| 1 | BAmammoth-1 | Baseten | 51.4 |
| 2 | CHQuyet-1.0-Large | chinhnc | 47.0 |
| 3 | TAJev 1.14 | TypeSafe AI | 46.6 |
|
About Decision Index Knowledge
What the benchmark measures and how its value is published, from the source’s own record.
What is Decision Index Knowledge?
Decision Index Knowledge (Decision Index 0.4 Knowledge) is an external benchmark published by Decision Index leaderboard. Decision Index 0.4 publishes chance-corrected knowledge scores for 209 evaluated systems. Its evaluation set is described by the source as knowledge area of the Decision Index evaluation. The source rates its difficulty as knowledge decision tasks.
How is Decision Index Knowledge scored?
Each model's result is published by Decision Index leaderboard as chance-corrected area score. ModelScale prints that value to 1 decimal place, exactly as published, and never converts or rescales it. This page ranks the 120 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.
ModelScale
