# Hermes Bench leaderboard

Agentic benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/leaderboards/benchmarks/agentic-hermes-bench

Hermes Bench: 150 agent tasks graded on the files and state the agent leaves behind. Every model the catalog carries a published Hermes Bench value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Agentic |
| Measure | pass@1 score |
| Tasks | 150 tasks across 25 categories |
| Difficulty | Frontier agentic |
| Published by | [Hermes Bench (Hermes Index)](https://portal.nousresearch.com/bench) |

Tests agents on 150 tasks across 25 categories, including Hermes skills, research, diagrams and art, memory, tool use and safety. Each agent starts in a workspace with real files, some tasks add follow-up turns, and the grader checks the files and state left behind.

## Hermes Bench ranking

17 models with a published Hermes Bench value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | pass@1 score | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [Claude Opus 5.5](https://modelscale.dev/models/claude-opus-5-5) | Anthropic | 76.7 | Observed 2026-10-23 · source benchlm:models |
| 2 | [Grok 4.7](https://modelscale.dev/models/grok-4-7) | xAI | 74.4 | Observed 2026-10-23 · source benchlm:models |
| 3 | [GPT-6.1 Sol](https://modelscale.dev/models/gpt-6-1-sol) | OpenAI | 73.9 | Observed 2026-10-23 · source benchlm:models |
| 4 | [GPT-6 Astra](https://modelscale.dev/models/gpt-6-astra) | OpenAI | 73.7 | Observed 2026-10-23 · source benchlm:models |
| 5 | [GPT-6 Sol](https://modelscale.dev/models/gpt-6-sol) | OpenAI | 73.5 | Observed 2026-10-23 · source benchlm:models |
| 6 | [Claude Sonnet 5.5](https://modelscale.dev/models/claude-sonnet-5-5) | Anthropic | 73.5 | Observed 2026-10-23 · source benchlm:models |
| 7 | [GLM-5.3](https://modelscale.dev/models/glm-5-3) | Z.AI | 71.8 | Observed 2026-10-23 · source benchlm:models |
| 8 | [Kimi K3](https://modelscale.dev/models/kimi-3) | Moonshot AI | 71.5 | Observed 2026-10-23 · source benchlm:models |
| 9 | [Claude Haiku 5.5](https://modelscale.dev/models/claude-haiku-5-5) | Anthropic | 71.0 | Observed 2026-10-23 · source benchlm:models |
| 10 | [DeepSeek V4.1 Flash 1017](https://modelscale.dev/models/deepseek-v4-1-flash) | DeepSeek | 70.7 | Last good 2026-10-19 · source benchlm:models |
| 11 | [Qwen3.8 Max](https://modelscale.dev/models/qwen3-8-max) | Alibaba | 70.5 | Observed 2026-10-23 · source benchlm:models |
| 12 | [GPT-6 Luna](https://modelscale.dev/models/gpt-6-luna) | OpenAI | 70.5 | Observed 2026-10-23 · source benchlm:models |
| 13 | [Step 5 Preview](https://modelscale.dev/models/step-5-preview) | StepFun | 69.2 | Observed 2026-10-23 · source benchlm:models |
| 14 | [GLM-5.3-Flash](https://modelscale.dev/models/glm-5-3-flash) | Z.AI | 68.9 | Observed 2026-10-23 · source benchlm:models |
| 15 | [Gemini 3.8 Flash](https://modelscale.dev/models/gemini-3-8-flash) | Google | 62.2 | Observed 2026-10-23 · source benchlm:models |
| 16 | [Hy4 preview](https://modelscale.dev/models/hy4-preview) | Tencent | 58.6 | Observed 2026-10-23 · source benchlm:models |
| 17 | [Ling 3.0 Flash](https://modelscale.dev/models/ling-3-0-flash) | InclusionAI | 53.8 | Observed 2026-10-23 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.