Loading page…
Preferred languages
More languages supported by Google Translate
Open the selector to load the current language catalog.
Translations are provided by Google Translate.
Loading page…
Preferred languages
More languages supported by Google Translate
Open the selector to load the current language catalog.
Translations are provided by Google Translate.
external benchmark
Every model the catalog carries a published AA-Omniscience-Decision accuracy value for, ranked by that value.
AA-Omniscience-Decision accuracy is one component of the Artificial Analysis Decision Index v1.0, run by Artificial Analysis. It is the share of 500 private knowledge questions answered correctly, each with four answers and an "I don't know" option.
13 models with a published AA-Omniscience-Decision accuracy value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.
| Rank | Model | Provider | Accuracy |
|---|---|---|---|
| 1 | Liquid AI | 41.0 | |
| 2 | Perplexity | 39.4 | |
| 3 | CLClef | Cloudflare | 39.0 |
What the benchmark measures and how its value is published, from the source’s own record.
AA-Omniscience-Decision accuracy is an external benchmark published by Artificial Analysis Decision Index v1.0. AA-Omniscience-Decision accuracy is one component of the Artificial Analysis Decision Index v1.0, run by Artificial Analysis. It is the share of 500 private knowledge questions answered correctly, each with four answers and an "I don't know" option. The source rates its difficulty as knowledge questions with an abstain option.
Each model's result is published by Artificial Analysis Decision Index v1.0 as accuracy. ModelScale prints that value to 1 decimal place, exactly as published, and never converts or rescales it. This page ranks the 13 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.
| 4 | CECeleris-1 Decision | Celeris | 37.8 |
| 5 | FAGLiDE | Fastino | 36.4 |
| 6 | CLClef-Omni | Cloudflare | 36.0 |
| 7 | Perplexity | 35.2 |
| 8 | Inception | 35.0 |
| 9 | TAJev 1.14 | TypeSafe AI | 33.8 |
| 10 | CLClef-Flash | Cloudflare | 32.6 |
| 11 | Liquid AI | 31.6 |
| 12 | Microsoft | 28.2 |
| 13 | BAelephant-1 | Baseten | 11.6 |
Evidence key: Observed
Rows are ordered by the value Artificial Analysis Decision Index v1.0 published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.