# AutomationBench (Zapier 1.0.6) leaderboard

Agentic benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/leaderboards/benchmarks/agentic-automation-bench-zapier106

AutomationBench, Zapier private evaluation set release 1.0.6. Every model the catalog carries a published AutomationBench (Zapier 1.0.6) value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Agentic |
| Measure | Task pass rate |
| Tasks | 600+ held-out workflows across 47 simulated applications and six business domains |
| Difficulty | Long-horizon automation |
| Published by | [AutomationBench](https://arxiv.org/abs/2604.18934) |

An agent benchmark for completing business workflows across simulated applications and API endpoints.

## AutomationBench (Zapier 1.0.6) ranking

1 model with a published AutomationBench (Zapier 1.0.6) value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Task pass rate | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [Claude Sonnet 5.5](https://modelscale.dev/models/claude-sonnet-5-5) | Anthropic | 44.70 | Observed 2026-10-23 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.