# Claude Haiku 4.5

Anthropic · Proprietary · rank 191 · bench-align-v5

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/models/claude-haiku-4-5  
JSON: https://modelscale.dev/api/model/claude-haiku-4-5

## Facts

| Field | Value | Evidence |
| --- | --- | --- |
| Canonical id | `claude-haiku-4-5` | — |
| Overall score | 33.8 | Observed 2026-11-21 · source benchlm:models |
| Verified score (BenchLM): a separate BenchLM figure, not the overall score | 50 | Observed 2026-11-21 · source benchlm:models |
| Context window | 200K tokens | Observed 2026-11-21 · source benchlm:models |
| Max output (models.dev) | 64,000 tokens | Observed 2026-11-21 · source modelsdev:catalog |
| Modalities (models.dev) | Input: text, image, PDF · Output: text | Observed 2026-11-21 · source modelsdev:catalog |
| Release date | 2025-10-15 | Observed 2026-11-21 · source benchlm:models |
| Access type | Proprietary | — |
| Blended $/1M (75% input / 25% output) | $2.00 | Derived from the input and output rates below |

## Capability evidence

Seven axes from the ranking source. An axis the source did not score is unavailable, not zero. Beside each score is BenchLM's separate verified score for that axis; the two are published side by side and are not interchangeable.

| Axis | Score | Evidence | Verified (BenchLM) | Verified evidence |
| --- | --- | --- | --- | --- |
| Agentic | Unavailable | Unavailable · source benchlm:models | Unavailable | Unavailable · source benchlm:models |
| Coding | 34.4 | Observed 2026-11-21 · source benchlm:models | 34.3 | Observed 2026-11-21 · source benchlm:models |
| Knowledge | 52.5 | Observed 2026-11-21 · source benchlm:models | 52.5 | Observed 2026-11-21 · source benchlm:models |
| Reasoning | Unavailable | Unavailable · source benchlm:models | Unavailable | Unavailable · source benchlm:models |
| Multimodal & Grounded | Unavailable | Unavailable · source benchlm:models | Unavailable | Unavailable · source benchlm:models |
| Instruction Following | Unavailable | Unavailable · source benchlm:models | Unavailable | Unavailable · source benchlm:models |
| Math | 28.8 | Last good 2026-10-08 · source benchlm:models | 28.8 | Last good 2026-10-08 · source benchlm:models |

## Runtime service evidence

Measured values with the date they were observed. Nothing is inferred from a sibling model or a provider claim. Regional or per-endpoint measurements appear only when the API supplies them; none are modelled.

| Measurement | Value | Observed | Last good | Evidence |
| --- | --- | --- | --- | --- |
| Time to first token | Unavailable | Unavailable | Unavailable | Unavailable · source benchlm:speed |
| Throughput | Unavailable | Unavailable | Unavailable | Unavailable · source benchlm:speed |

## Endpoint and price matrix

Every published price component, including cache reads and writes.

| Component | USD | Evidence |
| --- | --- | --- |
| Input / 1M tokens | $1.00 | Observed 2026-11-21 · source benchlm:pricing |
| Output / 1M tokens | $5.00 | Observed 2026-11-21 · source benchlm:pricing |
| Cache read / 1M tokens | $0.10 | Observed 2026-11-21 · source benchlm:pricing |
| Cache write / 1M tokens | $1.25 | Observed 2026-11-21 · source modelsdev:catalog |
| Blended / 1M (75% input / 25% output) | $2.00 | Derived — from the input and output rates above; it has no source record of its own |
| Cost per successful task (LiveBench) | Unavailable | Unavailable · source livebench:table |

**Pricing note.** Anthropic official public pricing for Claude Haiku 4.5 as referenced by Anthropic's April 2026 model pages.

## Workload-aware monthly cost example

10 conversations per day × 8 messages × 22 active days, 1200 input and 400 output tokens per message, no cache. Derived here from the published rates above by this site's own calculator — not a figure any source published.

| Field | Value |
| --- | --- |
| Modelled monthly cost | $5.63 |
| Modelled tokens | 2.82M |

## Benchmark record

21 matched benchmark rows with their published value, unit, and provenance.

### Knowledge

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| GPQA Diamond (Vals) (GPQA Diamond, Vals AI run) | 72.2 | Graduate-level science questions | Expert reasoning | [Vals AI GPQA Diamond, Vals AI run leaderboard](https://www.vals.ai/benchmarks/gpqa) |
| MMLU-Pro (Vals) (MMLU-Pro, Vals AI run) | 78.7 | Academic multiple-choice questions | Broad academic knowledge | [Vals AI MMLU-Pro, Vals AI run leaderboard](https://www.vals.ai/benchmarks/mmlu_pro) |

### Coding

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| SWE-bench Verified (Software Engineering Benchmark Verified) | 73.3 | 500 verified issues | Professional software engineering | [SWE-bench: Can Language Models Resolve Real-World GitHub Issues?](https://arxiv.org/abs/2310.06770) |
| VulcanBench v3 | 76.2 | 23 post-cutoff repository tasks in the v3 report | Professional multi-file software engineering | [VulcanBench](https://github.com/morganlinton/VulcanBench/tree/main) |
| LiveCodeBench (Vals) (LiveCodeBench, Vals AI run) | 41.2 | Competitive programming problems (easy, medium, hard) | Frontier coding | [Vals AI LiveCodeBench, Vals AI run leaderboard](https://www.vals.ai/benchmarks/lcb) |
| SWE-bench (Vals) (SWE-bench, Vals AI run) | 66.6 | Real repository issues by human time bucket | Frontier coding agents | [Vals AI SWE-bench, Vals AI run leaderboard](https://www.vals.ai/benchmarks/swebench) |

### Mathematics

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| FrontierMath v2 (Tiers 1-3) (FrontierMath v2 Tiers 1-3) | 5.903 | 285 private advanced mathematics problems | From olympiad-plus to early research mathematics | [FrontierMath v2 benchmark hub](https://epoch.ai/benchmarks/frontiermath-tiers-1-3-v2) |
| FrontierMath v2 (Tier 4) (FrontierMath v2 Tier 4) | 2.083 | 41 private extreme-difficulty mathematics problems | Research-level mathematics requiring hours or days of expert work | [FrontierMath Tier 4 v2 leaderboard](https://epoch.ai/benchmarks/frontiermath-tier-4-v2?view=graph&tab=leaderboard) |

### Agentic

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| JobBench | 16.0 | 130 tasks across 35 occupations | Professional multi-source workflows | [JobBench: Aligning Agent Work With Human Will](https://arxiv.org/abs/2605.26329) |
| Terminal-Bench 2.1 (Vals) (Terminal-Bench 2.1, Vals AI run) | 43.8 | Difficult terminal tasks | Frontier agentic | [Vals AI Terminal-Bench 2.1, Vals AI run leaderboard](https://www.vals.ai/benchmarks/terminal-bench-2-1) |
| MazeBench (MazeBench: visual spatial reasoning in a 3D open world) | 0 | 100 hidden gems across 256 rooms in one open world | Long-horizon spatial planning, with single puzzles that can take over one hundred moves | [MazeBench Results](https://mazebench.com/blog?post=maze-bench-results) |
| OSWorld 2.1 Offline (OSWorld 2.1 offline subset (82 tasks)) | 15.7 | 82 offline computer-use workflows | Long-horizon professional workflows | [OSWorld 2.1 release (xlang-ai/OSWorld-V2, tag osworld-v2.1)](https://github.com/xlang-ai/OSWorld-V2/releases) |

### Multimodal & Grounded

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| Design Arena Website (Design Arena Website Elo) | 1111 | Website generation comparisons | Design and website generation | [OpenRouter Grok 4.3 benchmarks](https://openrouter.ai/x-ai/grok-4.3/benchmarks) |
| ParseBench-1 (ParseBench-1: document parsing for AI agents (LlamaIndex leaderboard, first release)) | 49.34 | 2,078 human-verified enterprise pages from insurance, finance and government documents | No method is strong on all five dimensions; charts and visual grounding separate the field | [ParseBench: A Document Parsing Benchmark for AI Agents](https://arxiv.org/abs/2604.08538) |

### external

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| Chess Puzzles (Chess Puzzles (Epoch AI)) | 8.0 | 100 programmatically generated chess positions with a single best move | Novel chess positions, single best move | [Chess Puzzles (Epoch AI)](https://epoch.ai/benchmarks/chess-puzzles) |
| FailureSensorIQ | 61.8 | Multiple-choice questions on sensors and failure modes for 10 industrial assets | Industrial maintenance and reliability knowledge | [BenchLM](https://benchlm.ai/benchmarks/failuresensoriq) |
| BinaryAudit (BinaryAudit (backdoor detection in compiled binaries)) | 10.5 | 19 backdoor and timebomb detection tasks on stripped binaries, three runs each (57 runs); 6 tooling and 8 clean-binary tasks reported alongside | Reverse engineering without source code or symbols | [We hid backdoors in ~40 MB binaries and asked AI + Ghidra to find them (Quesma)](https://quesma.com/blog/introducing-binaryaudit/) |
| OTelBench (OTelBench (OpenTelemetry instrumentation tasks)) | 5.8 | 23 OpenTelemetry instrumentation tasks in 11 languages, three attempts each (69 runs) | Distributed tracing and context propagation across services | [Benchmarking OpenTelemetry: can AI trace your failed login? (Quesma)](https://quesma.com/blog/introducing-otel-bench/) |
| CompileBench (CompileBench (building real projects from source, pass@1)) | 68.9 | 15 build tasks on cowsay, jq, GNU coreutils and curl, three attempts each (45 attempts) | Dependency resolution, legacy toolchains, static linking and cross-compilation | [CompileBench: can AI compile 22-year-old code? (Quesma)](https://quesma.com/blog/introducing-compilebench/) |
| NYT Connections (NYT Connections LLM Benchmark (extended version)) | 14.3 | 940 NYT Connections puzzles, each with up to four added trick words | Wordplay, word knowledge and decoys that fit almost-but-not-quite | [NYT Connections LLM Benchmark (Lech Mazur, GitHub)](https://github.com/lechmazur/nyt-connections) |
| SkillsBench official leaderboard (BenchFlow) (SkillsBench v1.1 official leaderboard (BenchFlow)) | 30.1 | 87 tasks in 8 domains (SkillsBench v1.1) | Multi-step agent tasks | [SkillsBench leaderboard](https://www.skillsbench.ai/leaderboard) |

## Lifecycle and limitations log

Lifecycle events the source associates with this model.

No lifecycle event references this model. That is not evidence the model has no lifecycle plan — only that this source published none.

## What this profile does not claim

Values are reproduced exactly as their sources published them, in the units those sources declared; none are converted, interpolated, or averaged across providers. Any field marked unavailable was attempted and not returned. Last attempted fetch for this model's score: 2026-11-21 01:17 UTC.
