Categoryexternal
MeasureAccuracy
DifficultyExpert-level multiple choice
HLE-MultiChoice is one component of the Artificial Analysis Decision Index v1.0, run by Artificial Analysis. It measures accuracy on the 513 text-only multiple-choice Humanity's Last Exam questions, each posed as one choice among lettered answers.
HLE-MultiChoice (Decision Index) ranking
13 models with a published HLE-MultiChoice (Decision Index) value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.
Models ranked by their published HLE-MultiChoice (Decision Index) value| Rank | Model | Provider | Accuracy |
|---|
| 1 | TAJev 1.14 | TypeSafe AI | 18.9 |
| 2 | BAelephant-1 | Baseten | 18.3 |
| 3 |  d1-ultra | Liquid AI | 15.0 |
|
About HLE-MultiChoice (Decision Index)
What the benchmark measures and how its value is published, from the source’s own record.
What is HLE-MultiChoice (Decision Index)?
HLE-MultiChoice (Decision Index) is an external benchmark published by Artificial Analysis Decision Index v1.0. HLE-MultiChoice is one component of the Artificial Analysis Decision Index v1.0, run by Artificial Analysis. It measures accuracy on the 513 text-only multiple-choice Humanity's Last Exam questions, each posed as one choice among lettered answers. The source rates its difficulty as expert-level multiple choice.
How is HLE-MultiChoice (Decision Index) scored?
Each model's result is published by Artificial Analysis Decision Index v1.0 as accuracy. ModelScale prints that value to 1 decimal place, exactly as published, and never converts or rescales it. This page ranks the 13 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.
ModelScale
