# HLE w/ tools leaderboard

Agentic benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/leaderboards/benchmarks/agentic-hle-with-tools

Humanity's Last Exam with tools. Every model the catalog carries a published HLE w/ tools value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Agentic |
| Measure | Pass@1 |
| Tasks | Expert questions with tool use |
| Difficulty | Frontier tool-augmented reasoning |
| Published by | [DeepSeek-V4 Technical Report](https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro/blob/main/DeepSeek_V4.pdf) |

Tool-augmented Humanity's Last Exam scores reported in DeepSeek-V4 thinking-mode evaluations.

## HLE w/ tools ranking

38 models with a published HLE w/ tools value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Pass@1 | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [Kimi K3.1 Pro](https://modelscale.dev/models/kimi-3-1-pro) | Moonshot AI | 70.0 | Observed 2026-11-21 · source benchlm:models |
| 2 | [Claude Opus 5.5](https://modelscale.dev/models/claude-opus-5-5) | Anthropic | 67.7 | Observed 2026-11-21 · source benchlm:models |
| 3 | [Claude Opus 5](https://modelscale.dev/models/claude-opus-5) | Anthropic | 64.7 | Observed 2026-11-21 · source benchlm:models |
| 4 | [Claude Sonnet 5.5](https://modelscale.dev/models/claude-sonnet-5-5) | Anthropic | 64.5 | Observed 2026-11-21 · source benchlm:models |
| 5 | [DeepSeek V4.1 Flash 1017](https://modelscale.dev/models/deepseek-v4-1-flash) | DeepSeek | 63.9 | Observed 2026-11-21 · source benchlm:models |
| 6 | [LongCat-2.5](https://modelscale.dev/models/longcat-2-5) | Meituan | 63.1 | Observed 2026-11-21 · source benchlm:models |
| 7 | [GLM-5.3](https://modelscale.dev/models/glm-5-3) | Z.AI | 62.5 | Observed 2026-11-21 · source benchlm:models |
| 8 | [Muse Spark Open](https://modelscale.dev/models/muse-spark-open) | Meta | 61.0 | Observed 2026-11-21 · source benchlm:models |
| 9 | [DeepSeek V4 Pro](https://modelscale.dev/models/deepseek-v4-pro) | DeepSeek | 60.0 | Observed 2026-11-21 · source benchlm:models |
| 9 | [DeepSeek V4 Pro 0813](https://modelscale.dev/models/deepseek-v4-pro-max) | DeepSeek | 60.0 | Last good 2026-11-18 · source benchlm:models |
| 11 | [Hy4](https://modelscale.dev/models/hy4) | Tencent | 59.1 | Observed 2026-11-21 · source benchlm:models |
| 12 | [Claude Haiku 5.5](https://modelscale.dev/models/claude-haiku-5-5) | Anthropic | 57.4 | Observed 2026-11-21 · source benchlm:models |
| 12 | [Claude Sonnet 5](https://modelscale.dev/models/claude-sonnet-5) | Anthropic | 57.4 | Observed 2026-11-21 · source benchlm:models |
| 14 | [GPT-6 Astra](https://modelscale.dev/models/gpt-6-astra) | OpenAI | 57.2 | Observed 2026-11-21 · source benchlm:models |
| 15 | [Ling 3.0 Flash Sante](https://modelscale.dev/models/ling-3-0-flash-sante) | InclusionAI | 57.1 | Observed 2026-11-21 · source benchlm:models |
| 16 | [Qwen3.8 Max](https://modelscale.dev/models/qwen3-8-max) | Alibaba | 56.2 | Observed 2026-11-21 · source benchlm:models |
| 17 | [Apodex 1.1](https://modelscale.dev/models/apodex-1-1) | Apodex | 56.1 | Observed 2026-11-21 · source benchlm:models |
| 17 | [Ornith-1.5-397B](https://modelscale.dev/models/ornith-1-5-397b) | Ornith AI | 56.1 | Observed 2026-11-21 · source benchlm:models |
| 19 | [Hy4 preview](https://modelscale.dev/models/hy4-preview) | Tencent | 55.4 | Observed 2026-11-21 · source benchlm:models |
| 20 | [GLM-5.3-Flash](https://modelscale.dev/models/glm-5-3-flash) | Z.AI | 55.3 | Observed 2026-11-21 · source benchlm:models |
| 21 | [Hy4 flash](https://modelscale.dev/models/hy4-flash) | Tencent | 55.2 | Observed 2026-11-21 · source benchlm:models |
| 22 | [Sage-A1.5](https://modelscale.dev/models/sage-a1-5) | InternScience | 55.1 | Observed 2026-11-21 · source benchlm:models |
| 23 | [GLM-5.2](https://modelscale.dev/models/glm-5-2) | Z.AI | 54.7 | Observed 2026-11-21 · source benchlm:models |
| 24 | [Qwen3.7 Max](https://modelscale.dev/models/qwen3-7-max) | Alibaba | 53.5 | Observed 2026-11-21 · source benchlm:models |
| 25 | [dots3-note Preview](https://modelscale.dev/models/dots3-note-preview) | Dots Studio | 52.6 | Observed 2026-11-21 · source benchlm:models |
| 26 | [GLM-5.1](https://modelscale.dev/models/glm-5-1) | Z.AI | 52.3 | Observed 2026-11-21 · source benchlm:models |
| 27 | [Beam 1.0 501B-A23B](https://modelscale.dev/models/reflection-beam) | Reflection AI | 51.1 | Observed 2026-11-21 · source benchlm:models |
| 27 | [Beam 1.0 501B-A23B FP8](https://modelscale.dev/models/reflection-beam-fp8) | Reflection AI | 51.1 | Observed 2026-11-21 · source benchlm:models |
| 27 | [Beam 1.0 501B-A23B NVFP4](https://modelscale.dev/models/reflection-beam-nvfp4) | Reflection AI | 51.1 | Observed 2026-11-21 · source benchlm:models |
| 30 | [GLM-5](https://modelscale.dev/models/glm-5) | Z.AI | 50.4 | Observed 2026-11-21 · source benchlm:models |
| 31 | [Agents-A1](https://modelscale.dev/models/agents-a1) | InternScience | 47.6 | Observed 2026-11-21 · source benchlm:models |
| 32 | [Step 3.7 Flash](https://modelscale.dev/models/step-3-7-flash) | StepFun | 47.2 | Observed 2026-11-21 · source benchlm:models |
| 33 | [DeepSeek V4 Flash 0731](https://modelscale.dev/models/deepseek-v4-flash-max) | DeepSeek | 45.1 | Observed 2026-11-21 · source benchlm:models |
| 34 | [Nemotron 3 Ultra](https://modelscale.dev/models/nemotron-3-ultra-500b) | NVIDIA | 37.4 | Observed 2026-11-21 · source benchlm:models |
| 35 | [Spark-X2.6-4B](https://modelscale.dev/models/spark-x2-6-4b) | SparkLLM | 36.9 | Observed 2026-11-21 · source benchlm:models |
| 36 | [Ornith-1.5-35B-A3B](https://modelscale.dev/models/ornith-1-5-35b-a3b) | Ornith AI | 33.4 | Observed 2026-11-21 · source benchlm:models |
| 37 | [Ornith-1.5-9B](https://modelscale.dev/models/ornith-1-5-9b) | Ornith AI | 30.5 | Observed 2026-11-21 · source benchlm:models |
| 38 | [LFM3-1.7B](https://modelscale.dev/models/lfm3-1-7b) | LiquidAI | 13.9 | Observed 2026-11-21 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
