# AutomationBench leaderboard

Agentic benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/leaderboards/benchmarks/agentic-automation-bench

Every model the catalog carries a published AutomationBench value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Agentic |
| Measure | Agent task-completion score |
| Tasks | 600 public automation tasks |
| Difficulty | Long-horizon automation |
| Published by | [Kimi K3: Open Frontier Intelligence](https://www.kimi.com/blog/kimi-k3) |

An agent benchmark for completing automation workflows in reproducible task environments.

## AutomationBench ranking

34 models with a published AutomationBench value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Agent task-completion score | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [MiniMax M3.1 Flash](https://modelscale.dev/models/minimax-m3-1-flash) | MiniMax | 62.2 | Observed 2026-11-21 · source benchlm:models |
| 2 | [ERNIE 5.5 Flash Preview](https://modelscale.dev/models/ernie-5-5-flash-preview) | Baidu | 61.9 | Observed 2026-11-21 · source benchlm:models |
| 3 | [DeepSeek V4.1 Flash 1017](https://modelscale.dev/models/deepseek-v4-1-flash) | DeepSeek | 60.5 | Observed 2026-11-21 · source benchlm:models |
| 4 | [Hy4](https://modelscale.dev/models/hy4) | Tencent | 56.2 | Observed 2026-11-21 · source benchlm:models |
| 5 | [Gemini 4 Carbon](https://modelscale.dev/models/gemini-4-carbon) | Google | 53.9 | Observed 2026-11-21 · source benchlm:models |
| 6 | [Atria Dawn Preview](https://modelscale.dev/models/atria-dawn-preview) | Shanghai Artificial Intelligence Laboratory | 53.8 | Observed 2026-11-21 · source benchlm:models |
| 7 | [MiMo-V2.6-Pro](https://modelscale.dev/models/mimo-v2-6-pro) | Xiaomi | 53.1 | Observed 2026-11-21 · source benchlm:models |
| 8 | [Ling 3.1 Flash](https://modelscale.dev/models/ling-3-1-flash) | InclusionAI | 52.5 | Observed 2026-11-21 · source benchlm:models |
| 9 | [MiMo-V2.6-Flash](https://modelscale.dev/models/mimo-v2-6-flash) | Xiaomi | 52.3 | Observed 2026-11-21 · source benchlm:models |
| 10 | [Hy4 flash](https://modelscale.dev/models/hy4-flash) | Tencent | 52.2 | Observed 2026-11-21 · source benchlm:models |
| 11 | [LongCat-2.5](https://modelscale.dev/models/longcat-2-5) | Meituan | 51.8 | Observed 2026-11-21 · source benchlm:models |
| 12 | [Claude Fable 5.2](https://modelscale.dev/models/claude-fable-5-2) | Anthropic | 51.4 | Observed 2026-11-21 · source benchlm:models |
| 13 | [Gemini 4 Argon](https://modelscale.dev/models/gemini-4-argon) | Google | 51.3 | Observed 2026-11-21 · source benchlm:models |
| 14 | [Ultramarine 1 Flash](https://modelscale.dev/models/ultramarine-1-flash) | Paper Instruments | 50.2 | Observed 2026-11-21 · source benchlm:models |
| 15 | [Muse Spark 1.3](https://modelscale.dev/models/muse-spark-1-3) | Meta | 49.4 | Observed 2026-11-21 · source benchlm:models |
| 16 | [GLM-5.3-Flash](https://modelscale.dev/models/glm-5-3-flash) | Z.AI | 48.8 | Observed 2026-11-21 · source benchlm:models |
| 17 | [GLM-5.3](https://modelscale.dev/models/glm-5-3) | Z.AI | 48.2 | Observed 2026-11-21 · source benchlm:models |
| 18 | [Step 5 Preview](https://modelscale.dev/models/step-5-preview) | StepFun | 44.0 | Observed 2026-11-21 · source benchlm:models |
| 19 | [GPT-6 Astra](https://modelscale.dev/models/gpt-6-astra) | OpenAI | 41.4 | Observed 2026-11-21 · source benchlm:models |
| 20 | [LFM3-1.7B](https://modelscale.dev/models/lfm3-1-7b) | LiquidAI | 41.3 | Observed 2026-11-21 · source benchlm:models |
| 21 | [Claude Opus 5.5](https://modelscale.dev/models/claude-opus-5-5) | Anthropic | 40.0 | Observed 2026-11-21 · source benchlm:models |
| 22 | [Ripple-65B Preview](https://modelscale.dev/models/ripple-65b-preview) | Ricursive Intelligence | 36.4 | Observed 2026-11-21 · source benchlm:models |
| 23 | [GPT-6.1 Sol](https://modelscale.dev/models/gpt-6-1-sol) | OpenAI | 36.1 | Observed 2026-11-21 · source benchlm:models |
| 24 | [GPT-6 Sol](https://modelscale.dev/models/gpt-6-sol) | OpenAI | 33.2 | Observed 2026-11-21 · source benchlm:models |
| 25 | [Hy4 preview](https://modelscale.dev/models/hy4-preview) | Tencent | 32.1 | Observed 2026-11-21 · source benchlm:models |
| 26 | [DeepSeek V4 Pro](https://modelscale.dev/models/deepseek-v4-pro) | DeepSeek | 31.8 | Observed 2026-11-21 · source benchlm:models |
| 26 | [DeepSeek V4 Pro 0813](https://modelscale.dev/models/deepseek-v4-pro-max) | DeepSeek | 31.8 | Last good 2026-11-18 · source benchlm:models |
| 28 | [Claude Fable 5.1](https://modelscale.dev/models/claude-fable-5-1) | Anthropic | 31.4 | Observed 2026-11-21 · source benchlm:models |
| 29 | [Kimi K3](https://modelscale.dev/models/kimi-3) | Moonshot AI | 30.8 | Observed 2026-11-21 · source benchlm:models |
| 30 | [Gemini 3.7 Flash](https://modelscale.dev/models/gemini-3-7-flash) | Google | 30.4 | Observed 2026-11-21 · source benchlm:models |
| 31 | [LFM2.5-24B-A2B](https://modelscale.dev/models/lfm2-5-24b-a2b) | LiquidAI | 27.7 | Observed 2026-11-21 · source benchlm:models |
| 32 | [Qwen3.8 Max](https://modelscale.dev/models/qwen3-8-max) | Alibaba | 27.3 | Observed 2026-11-21 · source benchlm:models |
| 33 | [Claude Opus 5](https://modelscale.dev/models/claude-opus-5) | Anthropic | 26.0 | Observed 2026-11-21 · source benchlm:models |
| 34 | [DeepSeek V4 Flash 0731](https://modelscale.dev/models/deepseek-v4-flash-max) | DeepSeek | 25.1 | Observed 2026-11-21 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
