# Claw-Eval leaderboard

Agentic benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/leaderboards/benchmarks/agentic-claw-eval

Every model the catalog carries a published Claw-Eval value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Agentic |
| Measure | End-to-end autonomous-agent evaluation with Pass^3 scoring |
| Tasks | 300 tasks, 2,159 rubrics |
| Difficulty | Real-world general, multi-turn, and native multimodal agent execution |
| Published by | [Claw-Eval: Towards Trustworthy Evaluation of Autonomous Agents](https://arxiv.org/abs/2604.06132) |

A transparent real-world autonomous-agent benchmark with 300 human-verified tasks, 2,159 rubric items, and Pass^3 scoring across general, multi-turn, and native multimodal agent tasks.

## Claw-Eval ranking

42 models with a published Claw-Eval value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | End-to-end autonomous-agent evaluation with Pass^3 scoring | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [Ornith-1.5-397B](https://modelscale.dev/models/ornith-1-5-397b) | Ornith AI | 81.4 | Observed 2026-11-21 · source benchlm:models |
| 2 | [LongCat-2.5](https://modelscale.dev/models/longcat-2-5) | Meituan | 78.3 | Observed 2026-11-21 · source benchlm:models |
| 3 | [K-EXAONE 2.0](https://modelscale.dev/models/k-exaone-2-0) | LG AI Research | 77.7 | Observed 2026-11-21 · source benchlm:models |
| 4 | [Ornith-1.0-397B](https://modelscale.dev/models/ornith-1-0-397b) | DeepReinforce AI | 77.1 | Observed 2026-11-21 · source benchlm:models |
| 5 | [MiniMax M3](https://modelscale.dev/models/minimax-m3) | MiniMax | 74.5 | Observed 2026-11-21 · source benchlm:models |
| 6 | [dots3-note Preview](https://modelscale.dev/models/dots3-note-preview) | Dots Studio | 73.4 | Observed 2026-11-21 · source benchlm:models |
| 7 | [Ornith-1.5-35B-A3B](https://modelscale.dev/models/ornith-1-5-35b-a3b) | Ornith AI | 72.5 | Observed 2026-11-21 · source benchlm:models |
| 8 | [Qwen3.6-27B](https://modelscale.dev/models/qwen3-6-27b) | Alibaba | 72.4 | Observed 2026-11-21 · source benchlm:models |
| 9 | [Claude Opus 4.6](https://modelscale.dev/models/claude-opus-4-6) | Anthropic | 70.4 | Observed 2026-11-21 · source benchlm:models |
| 10 | [Spark-X2.6-4B](https://modelscale.dev/models/spark-x2-6-4b) | SparkLLM | 69.9 | Observed 2026-11-21 · source benchlm:models |
| 11 | [Ornith-1.0-35B](https://modelscale.dev/models/ornith-1-0-35b) | DeepReinforce AI | 69.8 | Observed 2026-11-21 · source benchlm:models |
| 12 | [Qwen3.6-35B-A3B](https://modelscale.dev/models/qwen3-6-35b-a3b) | Alibaba | 68.7 | Observed 2026-11-21 · source benchlm:models |
| 13 | [LFM3-1.7B](https://modelscale.dev/models/lfm3-1-7b) | LiquidAI | 68.6 | Observed 2026-11-21 · source benchlm:models |
| 14 | [Claude Sonnet 4.6](https://modelscale.dev/models/claude-sonnet-4-6) | Anthropic | 67.8 | Observed 2026-11-21 · source benchlm:models |
| 15 | [Step 3.7 Flash](https://modelscale.dev/models/step-3-7-flash) | StepFun | 67.1 | Observed 2026-11-21 · source benchlm:models |
| 16 | [Ornith-1.5-9B](https://modelscale.dev/models/ornith-1-5-9b) | Ornith AI | 66.5 | Observed 2026-11-21 · source benchlm:models |
| 17 | [Qwen3.7 Max](https://modelscale.dev/models/qwen3-7-max) | Alibaba | 65.2 | Observed 2026-11-21 · source benchlm:models |
| 18 | [LLaDA2.2-flash](https://modelscale.dev/models/llada2-2-flash) | InclusionAI | 64.2 | Observed 2026-11-21 · source benchlm:models |
| 19 | [MiMo-V2.5-Pro](https://modelscale.dev/models/mimo-v2-5-pro) | Xiaomi | 63.8 | Observed 2026-11-21 · source benchlm:models |
| 19 | [Muse Spark](https://modelscale.dev/models/muse-spark) | Meta | 63.8 | Observed 2026-11-21 · source benchlm:models |
| 21 | [Ornith-1.0-9B](https://modelscale.dev/models/ornith-1-0-9b) | DeepReinforce AI | 63.1 | Observed 2026-11-21 · source benchlm:models |
| 22 | [LFM2.5-2.6B](https://modelscale.dev/models/lfm2-5-2-6b) | LiquidAI | 62.9 | Observed 2026-11-21 · source benchlm:models |
| 23 | [Qwen3.7 Plus](https://modelscale.dev/models/qwen3-7-plus) | Alibaba | 62.7 | Observed 2026-11-21 · source benchlm:models |
| 24 | [GLM-5.1](https://modelscale.dev/models/glm-5-1) | Z.AI | 62.3 | Observed 2026-11-21 · source benchlm:models |
| 24 | [Kimi K2.6](https://modelscale.dev/models/kimi-2-6) | Moonshot AI | 62.3 | Observed 2026-11-21 · source benchlm:models |
| 24 | [MiMo-V2.5](https://modelscale.dev/models/mimo-v2-5) | Xiaomi | 62.3 | Observed 2026-11-21 · source benchlm:models |
| 27 | [GPT-5.4](https://modelscale.dev/models/gpt-5-4) | OpenAI | 60.3 | Observed 2026-11-21 · source benchlm:models |
| 28 | [Claude Opus 4.5](https://modelscale.dev/models/claude-opus-4-5) | Anthropic | 59.6 | Observed 2026-11-21 · source benchlm:models |
| 29 | [Qwen3.6 Plus](https://modelscale.dev/models/qwen3-6-plus) | Alibaba | 58.8 | Observed 2026-11-21 · source benchlm:models |
| 30 | [Gemini 3.1 Pro](https://modelscale.dev/models/gemini-3-1-pro) | Google | 57.8 | Observed 2026-11-21 · source benchlm:models |
| 30 | [MiMo-V2-Pro](https://modelscale.dev/models/mimo-v2-pro) | Xiaomi | 57.8 | Observed 2026-11-21 · source benchlm:models |
| 32 | [GLM-5](https://modelscale.dev/models/glm-5) | Z.AI | 57.7 | Observed 2026-11-21 · source benchlm:models |
| 33 | [LLaDA2.2-mini](https://modelscale.dev/models/llada2-2-mini) | InclusionAI | 57.2 | Observed 2026-11-21 · source benchlm:models |
| 34 | [Qwen3.5 397B](https://modelscale.dev/models/qwen3-5-397b) | Alibaba | 56.8 | Observed 2026-11-21 · source benchlm:models |
| 35 | [GLM-5-Turbo](https://modelscale.dev/models/glm-5-turbo) | Z.AI | 55.8 | Observed 2026-11-21 · source benchlm:models |
| 36 | [GLM-5V-Turbo](https://modelscale.dev/models/glm-5v-turbo) | Z.AI | 53.8 | Observed 2026-11-21 · source benchlm:models |
| 37 | [Kimi K2.5](https://modelscale.dev/models/kimi-k2-5) | Moonshot AI | 52.3 | Observed 2026-11-21 · source benchlm:models |
| 38 | [Gemini 3 Flash](https://modelscale.dev/models/gemini-3-flash) | Google | 49.2 | Observed 2026-11-21 · source benchlm:models |
| 39 | [MiniMax M2.7](https://modelscale.dev/models/minimax-m2-7) | MiniMax | 48.7 | Observed 2026-11-21 · source benchlm:models |
| 40 | [MiMo-V2-Omni](https://modelscale.dev/models/mimo-v2-omni) | Xiaomi | 45.2 | Observed 2026-11-21 · source benchlm:models |
| 41 | [DeepSeek V3.2](https://modelscale.dev/models/deepseek-v3-2) | DeepSeek | 40.2 | Observed 2026-11-21 · source benchlm:models |
| 42 | [Nemotron 3 Super 100B](https://modelscale.dev/models/nemotron-3-super-100b) | NVIDIA | 5.5 | Observed 2026-11-21 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
