# HLE-MultiChoice (Decision Index) leaderboard

external benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/leaderboards/benchmarks/external-aa-decision-hle-multi-choice

Every model the catalog carries a published HLE-MultiChoice (Decision Index) value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | external |
| Measure | Accuracy |
| Tasks | — |
| Difficulty | Expert-level multiple choice |
| Published by | [Artificial Analysis Decision Index v1.0](https://artificialanalysis.ai/articles/artificial-analysis-decision-index) |

HLE-MultiChoice is one component of the Artificial Analysis Decision Index v1.0, run by Artificial Analysis. It measures accuracy on the 513 text-only multiple-choice Humanity's Last Exam questions, each posed as one choice among lettered answers.

## HLE-MultiChoice (Decision Index) ranking

13 models with a published HLE-MultiChoice (Decision Index) value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Accuracy | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [Jev 1.14](https://modelscale.dev/models/jev-1-14) | TypeSafe AI | 18.9 | Observed 2026-10-23 · source benchlm:models |
| 2 | [elephant-1](https://modelscale.dev/models/elephant-1) | Baseten | 18.3 | Observed 2026-10-23 · source benchlm:models |
| 3 | [d1-ultra](https://modelscale.dev/models/d1-ultra) | Liquid AI | 15.0 | Observed 2026-10-23 · source benchlm:models |
| 4 | [Perplexity Decider v1.2 27B](https://modelscale.dev/models/pplx-decider-v1-2) | Perplexity | 14.6 | Observed 2026-10-23 · source benchlm:models |
| 5 | [Celeris-1 Decision](https://modelscale.dev/models/celeris-1-decision) | Celeris | 13.3 | Observed 2026-10-23 · source benchlm:models |
| 6 | [Perplexity Decider Flash v1.2 4B](https://modelscale.dev/models/pplx-decider-flash-v1-2) | Perplexity | 12.1 | Observed 2026-10-23 · source benchlm:models |
| 7 | [d1](https://modelscale.dev/models/liquid-d1) | Liquid AI | 11.5 | Observed 2026-10-23 · source benchlm:models |
| 8 | [Clef](https://modelscale.dev/models/cloudflare-clef) | Cloudflare | 11.1 | Observed 2026-10-23 · source benchlm:models |
| 9 | [Microsoft-Decision-1](https://modelscale.dev/models/microsoft-decision-1) | Microsoft | 10.9 | Observed 2026-10-23 · source benchlm:models |
| 10 | [GLiDE](https://modelscale.dev/models/fastino-glide) | Fastino | 10.5 | Observed 2026-10-23 · source benchlm:models |
| 11 | [Clef-Flash](https://modelscale.dev/models/cloudflare-clef-flash) | Cloudflare | 10.3 | Observed 2026-10-23 · source benchlm:models |
| 12 | [Mercury Decide](https://modelscale.dev/models/mercury-decide) | Inception | 10.1 | Observed 2026-10-23 · source benchlm:models |
| 13 | [Clef-Omni](https://modelscale.dev/models/cloudflare-clef-omni) | Cloudflare | 9.0 | Observed 2026-10-23 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.