# Claude Sonnet 5.5

Anthropic · Proprietary · rank 6 · bench-align-v5

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/models/claude-sonnet-5-5  
JSON: https://modelscale.dev/api/model/claude-sonnet-5-5

## Facts

| Field | Value | Evidence |
| --- | --- | --- |
| Canonical id | `claude-sonnet-5-5` | — |
| Overall score | 82.24 | Observed 2026-10-23 · source benchlm:models |
| Context window | 1M tokens | Observed 2026-10-23 · source benchlm:models |
| Release date | 2026-09-28 | Observed 2026-10-23 · source benchlm:models |
| Access type | Proprietary | — |
| Blended $/1M (75% input / 25% output) | $4.00 | Derived from the input and output rates below |

## Capability evidence

Seven axes from the ranking source. An axis the source did not score is unavailable, not zero.

| Axis | Score | Evidence |
| --- | --- | --- |
| Agentic | 78.8 | Observed 2026-10-23 · source benchlm:models |
| Coding | 87.5 | Observed 2026-10-23 · source benchlm:models |
| Knowledge | 83.4 | Observed 2026-10-23 · source benchlm:models |
| Reasoning | 81.8 | Observed 2026-10-23 · source benchlm:models |
| Multimodal & Grounded | 86.7 | Observed 2026-10-23 · source benchlm:models |
| Instruction Following | Unavailable | Unavailable · source benchlm:models |
| Math | 95.2 | Observed 2026-10-23 · source benchlm:models |

## Runtime service evidence

Measured values with the date they were observed. Nothing is inferred from a sibling model or a provider claim. Regional or per-endpoint measurements appear only when the API supplies them; none are modelled.

| Measurement | Value | Observed | Last good | Evidence |
| --- | --- | --- | --- | --- |
| Time to first token | 394.99 s | 2026-10-23 | 2026-10-23 | Observed 2026-10-23 · source benchlm:speed |
| Throughput | 136 tok/s | 2026-10-23 | 2026-10-23 | Observed 2026-10-23 · source benchlm:speed |

## Endpoint and price matrix

Every published price component, including cache reads and writes.

| Component | USD | Evidence |
| --- | --- | --- |
| Input / 1M tokens | $2.00 | Observed 2026-10-23 · source benchlm:pricing |
| Output / 1M tokens | $10.00 | Observed 2026-10-23 · source benchlm:pricing |
| Cache read / 1M tokens | $0.10 | Observed 2026-10-23 · source benchlm:pricing |
| Cache write / 1M tokens | $2.50 | Observed 2026-10-23 · source openrouter:pricing |
| Blended / 1M (75% input / 25% output) | $4.00 | Derived — from the input and output rates above; it has no source record of its own |
| Cost per successful task (LiveBench) | Unavailable | Fetch failed · source livebench:table |

**Self-hosted listing.** Anthropic’s current pricing docs list $2 per million input tokens, $10 per million output tokens, $0.10 cache reads, $2.50 five-minute cache writes, and $4 one-hour cache writes. The October 7, 2026 Haiku 5.5 announcement cut Sonnet 5.5 cache reads by 50% from $0.20. Batch API rates are $1 input and $5 output per million tokens; the cached-input batch estimate is half the current cache-read rate. Anthropic states that the 1M context window is included at standard pricing. The rates above are a hosted price matched from another provider, not a first-party list price.

## Workload-aware monthly cost example

10 conversations per day × 8 messages × 22 active days, 1200 input and 400 output tokens per message, no cache. Derived here from the published rates above by this site's own calculator — not a figure any source published.

| Field | Value |
| --- | --- |
| Modelled monthly cost | $11.26 |
| Modelled tokens | 2.82M |

## Benchmark record

73 matched benchmark rows with their published value, unit, and provenance.

### Knowledge

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| HealthBench (raw) (HealthBench raw score) | 69.4 | 5,000 multi-turn patient conversations | Realistic healthcare conversations | [HealthBench: Evaluating Large Language Models Towards Improved Human Health](https://arxiv.org/abs/2505.08775) |
| HealthBench (length-adjusted) (HealthBench length-adjusted score) | 65.4 | 5,000 multi-turn patient conversations | Realistic healthcare conversations | [HealthBench: Evaluating Large Language Models Towards Improved Human Health](https://arxiv.org/abs/2505.08775) |
| HealthBench Professional (raw) (HealthBench Professional raw score) | 77.1 | 525 physician-authored conversations | Professional clinical tasks | [HealthBench Professional: Evaluating Large Language Models on Real Clinician Chats](https://arxiv.org/abs/2604.27470) |
| BioMysteryBench (human-solvable) (BioMysteryBench Human Solvable) | 89.2 | Human-solvable computational biology investigations | Expert computational biology | [Claude Opus 5 System Card](https://www-cdn.anthropic.com/c5fbac3f0b1280a933ebd26d3cb8bb9f5bdeaf48/Claude%20Opus%205%20System%20Card.pdf) |
| BioMysteryBench (human-difficult) (BioMysteryBench Human Difficult) | 44.7 | Human-difficult computational biology investigations | Frontier computational biology | [Claude Opus 5 System Card](https://www-cdn.anthropic.com/c5fbac3f0b1280a933ebd26d3cb8bb9f5bdeaf48/Claude%20Opus%205%20System%20Card.pdf) |
| SpatialBench Verified (LatchBio SpatialBench Verified) | 72.5 | 115 externally validated spatial transcriptomics problems | Professional bioinformatics | [Claude Opus 5 System Card](https://www-cdn.anthropic.com/c5fbac3f0b1280a933ebd26d3cb8bb9f5bdeaf48/Claude%20Opus%205%20System%20Card.pdf) |
| SingleCellBench (LatchBio SingleCellBench) | 59.1 | 195 single-cell RNA sequencing problems | Professional bioinformatics | [Claude Opus 5 System Card](https://www-cdn.anthropic.com/c5fbac3f0b1280a933ebd26d3cb8bb9f5bdeaf48/Claude%20Opus%205%20System%20Card.pdf) |
| Protein Design (Anthropic Protein Design evaluation) | 51.0 | Constrained protein-sequence design tasks | Computational protein design | [Claude Opus 5 System Card](https://www-cdn.anthropic.com/c5fbac3f0b1280a933ebd26d3cb8bb9f5bdeaf48/Claude%20Opus%205%20System%20Card.pdf) |
| Protocols (troubleshooting) (Molecular Biology Protocols Troubleshooting) | 67.3 | Molecular-biology protocol troubleshooting | Expert laboratory protocols | [Claude Opus 5 System Card](https://www-cdn.anthropic.com/c5fbac3f0b1280a933ebd26d3cb8bb9f5bdeaf48/Claude%20Opus%205%20System%20Card.pdf) |
| Protocols (understanding) (Benchling Molecular Biology Protocols Understanding) | 66.6 | Molecular-biology protocol extension | Expert laboratory protocols | [Claude Opus 5 System Card](https://www-cdn.anthropic.com/c5fbac3f0b1280a933ebd26d3cb8bb9f5bdeaf48/Claude%20Opus%205%20System%20Card.pdf) |
| Artificial Analysis Intelligence Index | 56.0 | Cross-benchmark intelligence index | Display-only external reference | [Artificial Analysis](https://artificialanalysis.ai/) |
| AA-HLE (Artificial Analysis Humanity's Last Exam) | 55.0 | Expert-level questions | Frontier expert reasoning | [Artificial Analysis Humanity's Last Exam Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/hle) |
| AA-Omniscience Index (Artificial Analysis Omniscience Index) | 32.3 | Knowledge questions | Broad factual knowledge | [AA-Omniscience: Knowledge and Hallucination Benchmark](https://artificialanalysis.ai/evaluations/omniscience) |
| AA-Omniscience Accuracy (Artificial Analysis Omniscience Accuracy) | 54.0 | Knowledge questions | Broad knowledge | [Artificial Analysis model benchmarks](https://artificialanalysis.ai/models/grok-4-3) |
| AA-Omniscience Hallucination Rate (Artificial Analysis Omniscience Hallucination Rate) | 47.0 | Knowledge questions | Factuality | [Artificial Analysis model benchmarks](https://artificialanalysis.ai/models/grok-4-3) |
| HealthBench Professional | 69.2 | Clinician chat tasks | Professional clinical workflows | [HealthBench Professional: Evaluating Large Language Models on Real Clinician Chats](https://arxiv.org/abs/2604.27470) |
| HLE w/o tools (Humanity's Last Exam without tools) | 56.9 | Expert-level questions | Frontier expert level | [Introducing GPT-5.4 mini and nano](https://openai.com/index/introducing-gpt-5-4-mini-and-nano/) |
| Morphology-to-molecule matching (Axiom Bio morphology-to-molecule matching) | 25.0 | Four multi-channel cell-imaging perturbation-matching tasks | Biomedical image and molecular reasoning | [Claude Opus 5.5 System Card](https://www-cdn.anthropic.com/fc1b44717c85dc068bc6ba5024219938094694bd/Claude%20Opus%205.5%20System%20Card.pdf) |
| Medicinal chemistry (Anthropic medicinal-chemistry evaluation) | 65.3 | 504 molecular-property questions | Medicinal chemistry reasoning | [Claude Opus 5.5 System Card](https://www-cdn.anthropic.com/fc1b44717c85dc068bc6ba5024219938094694bd/Claude%20Opus%205.5%20System%20Card.pdf) |
| Protein Design library ranking (Anthropic protein-design library-ranking task) | 54.8 | 83 protein-design library-ranking problems | Computational protein design | [Claude Opus 5.5 System Card](https://www-cdn.anthropic.com/fc1b44717c85dc068bc6ba5024219938094694bd/Claude%20Opus%205.5%20System%20Card.pdf) |
| De novo protein-binder design (Anthropic de novo protein-binder design evaluation) | 82.3 | 15 protein targets | Long-horizon computational protein design | [Claude Opus 5.5 System Card](https://www-cdn.anthropic.com/fc1b44717c85dc068bc6ba5024219938094694bd/Claude%20Opus%205.5%20System%20Card.pdf) |

### Coding

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| SWE-bench Pro | 81.3 | 1,865 repository problems | Long-horizon professional engineering | [SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?](https://arxiv.org/abs/2509.16941) |
| FrontierCode 1.1 Main | 46.2 | 100 private Main tasks (150 in Extended) | Frontier coding-agent quality | [FrontierCode leaderboard](https://cognition.com/frontiercode) |
| FrontierCode 1.1 Extended | 59.1 | 150 private software-engineering tasks | Frontier coding-agent quality | [FrontierCode leaderboard](https://cognition.com/frontiercode) |
| SWE Multilingual | 90.3 | Multilingual software-engineering tasks | Professional software engineering | [MiniMax M2.7: Early Echoes of Self-Evolution](https://www.minimax.io/news/minimax-m27-en) |
| SWE Multimodal (SWE-bench Multimodal) | 54.3 | Multimodal software engineering tasks | Frontier multimodal coding | [SWE-bench Multimodal](https://www.swebench.com/multimodal) |
| ProgramBench (ProgramBench: Can Language Models Rebuild Programs From Scratch?) | 79.7 | 200 program reconstruction tasks | Full-repository software architecture | [ProgramBench: Can Language Models Rebuild Programs From Scratch?](https://programbench.com/static/paper.pdf) |
| FrontierSWE v2 | 61.9 | 34 ultra-long-horizon engineering and research tasks | Ultra-long-horizon frontier software engineering | [FrontierSWE v2](https://www.frontierswe.com/blog/v2) |
| Bug Hunt Bench | 51.3 | 105 planted bugs across two production TypeScript repositories | Blind production-repository bug finding and repair | [Bug Hunt Bench method, caveats, and definitions](https://bughunt.productcompass.pm/method) |
| AA-SciCode (Artificial Analysis SciCode) | 61.0 | Scientific coding subproblems | Scientific programming | [Artificial Analysis SciCode Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/scicode) |
| DeepSWE | 71.0 | 113 software engineering tasks across 91 repositories and 5 languages | Long-horizon software engineering | [DeepSWE benchmark blog](https://deepswe.datacurve.ai/blog) |

### Mathematics

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| FrontierMath v2 (Tiers 1-3) (FrontierMath v2 Tiers 1-3) | 88.772 | 285 private advanced mathematics problems | From olympiad-plus to early research mathematics | [FrontierMath v2 benchmark hub](https://epoch.ai/benchmarks/frontiermath-tiers-1-3-v2) |
| FrontierMath v2 (Tier 4) (FrontierMath v2 Tier 4) | 80.488 | 41 private extreme-difficulty mathematics problems | Research-level mathematics requiring hours or days of expert work | [FrontierMath Tier 4 v2 leaderboard](https://epoch.ai/benchmarks/frontiermath-tier-4-v2?view=graph&tab=leaderboard) |
| ArXivMath Aug. 2026 (no tools) (ArXivMath August 2026 without tools) | 86.8 | 57 recent research-mathematics problems | Research mathematics | [Claude Opus 5.5 System Card](https://www-cdn.anthropic.com/fc1b44717c85dc068bc6ba5024219938094694bd/Claude%20Opus%205.5%20System%20Card.pdf) |
| ArXivMath Aug. 2026 (tools) (ArXivMath August 2026 with tools) | 95.2 | 57 recent research-mathematics problems | Research mathematics | [Claude Opus 5.5 System Card](https://www-cdn.anthropic.com/fc1b44717c85dc068bc6ba5024219938094694bd/Claude%20Opus%205.5%20System%20Card.pdf) |

### Reasoning

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| AA-LCR (Artificial Analysis Long Context Reasoning) | 82.7 | Long-context reasoning tasks | Long-context reasoning | [Artificial Analysis model benchmarks](https://artificialanalysis.ai/models/grok-4-3) |
| MLCR-AA (Medical Long Context Reasoning (MLCR-AA)) | 75.0 | Long, fragmented medical-record reasoning | Long-context medical reasoning | [Medical Long Context Reasoning (MLCR-AA)](https://artificialanalysis.ai/evaluations/mlcr-aa) |
| CritPt (Critical Physics Tasks) | 31.4 | Research-level physics questions | Research-level physics reasoning | [CritPt Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/critpt) |

### Multilingual

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| GMMLU (Global MMLU) | 92.1 | Knowledge questions across 42 languages | Multilingual knowledge | [Global MMLU: Understanding and addressing cultural and linguistic biases in multilingual evaluation](https://arxiv.org/abs/2412.03304) |
| MILU (Multi-task Indic Language Understanding Benchmark) | 91.6 | Knowledge tasks across 11 languages | Multilingual Indic knowledge | [MILU: A Multi-task Indic language understanding benchmark](https://arxiv.org/abs/2411.02538) |

### Agentic

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| DRACO (Data Research and Analysis with Complex Operations) | 87.0 | Agentic data research and analysis tasks | Professional data analysis | [Claude Opus 5 System Card](https://www-cdn.anthropic.com/c5fbac3f0b1280a933ebd26d3cb8bb9f5bdeaf48/Claude%20Opus%205%20System%20Card.pdf) |
| LAB all-pass (Harvey held-out) (Legal Agent Benchmark all-pass rate — Harvey held-out set) | 10.0 | Harvey-held-out legal-agent tasks | Professional legal work | [Claude Opus 5 System Card](https://www-cdn.anthropic.com/c5fbac3f0b1280a933ebd26d3cb8bb9f5bdeaf48/Claude%20Opus%205%20System%20Card.pdf) |
| LAB criterion-pass (Harvey held-out) (Legal Agent Benchmark mean criterion-pass rate — Harvey held-out set) | 93.1 | Harvey-held-out legal-agent tasks | Professional legal work | [Claude Opus 5 System Card](https://www-cdn.anthropic.com/c5fbac3f0b1280a933ebd26d3cb8bb9f5bdeaf48/Claude%20Opus%205%20System%20Card.pdf) |
| Toolathlon Verified Pass@3 | 85.2 | 108 verified real-world tool-use tasks | Long-horizon application tool use | [Claude Opus 5 System Card](https://www-cdn.anthropic.com/c5fbac3f0b1280a933ebd26d3cb8bb9f5bdeaf48/Claude%20Opus%205%20System%20Card.pdf) |
| Toolathlon Verified Pass³ (Toolathlon Verified Pass cubed) | 68.5 | 108 verified real-world tool-use tasks | Long-horizon application tool use | [Claude Opus 5 System Card](https://www-cdn.anthropic.com/c5fbac3f0b1280a933ebd26d3cb8bb9f5bdeaf48/Claude%20Opus%205%20System%20Card.pdf) |
| Toolathlon Verified avg. turns (Toolathlon Verified average assistant turns) | 31.6 | 108 verified real-world tool-use tasks | Long-horizon application tool use | [Claude Opus 5 System Card](https://www-cdn.anthropic.com/c5fbac3f0b1280a933ebd26d3cb8bb9f5bdeaf48/Claude%20Opus%205%20System%20Card.pdf) |
| Terminal-Bench 4.0 | 70.60 | 66 professional computer-work tasks | Frontier autonomous knowledge work | [Terminal-Bench 4.0](https://www.tbench.ai/news/terminal-bench-4-0) |
| Terminal-Bench-Science 0.1 | 59.9 | 70 expert-curated scientific research workflows | Frontier scientific research workflows | [Terminal-Bench-Science 0.1](https://www.terminal-bench-science.ai/) |
| AA Briefcase (Artificial Analysis Briefcase) | 1811 | Professional knowledge-work tasks | Professional work | [Artificial Analysis Briefcase Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/aa-briefcase) |
| AA AutomationBench (Artificial Analysis AutomationBench) | 71.8 | Business-process automation tasks | Agentic automation | [Artificial Analysis AutomationBench Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/automationbench-aa) |
| AA Harvey LAB v1.0 (Artificial Analysis Harvey LAB-AA v1.0) | 93.1 | Legal agent tasks | Professional legal work | [Artificial Analysis Harvey LAB-AA Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/harvey-lab-aa) |
| HLE w/ tools (Humanity's Last Exam with tools) | 64.5 | Expert questions with tool use | Frontier tool-augmented reasoning | [DeepSeek-V4 Technical Report](https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro/blob/main/DeepSeek_V4.pdf) |
| GDPval-AA | 1844 | Agentic real-world work tasks | Professional agentic workflows | [DeepSeek-V4 Technical Report](https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro/blob/main/DeepSeek_V4.pdf) |
| GDPval-AA (GDPval-AA normalized) | 66.9 | Economically valuable tasks | Professional agentic workflows | [Artificial Analysis model benchmarks](https://artificialanalysis.ai/models/grok-4-3) |
| AA Terminal-Bench 4.0 (Artificial Analysis Terminal-Bench v4.0) | 63.6 | Terminal-based agent tasks | Agentic software engineering | [Artificial Analysis Terminal-Bench v4.0 Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/terminalbench-v4-0) |
| GDP.pdf (Artificial Analysis GDP.pdf) | 25.8 | Professional document-production tasks | Professional knowledge work | [GDP.pdf Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/gdp-pdf) |
| AA-AnalystAgent (Artificial Analysis AnalystAgent) | 57.5 | Spreadsheet and document analysis questions | Business and data analysis | [AA-AnalystAgent Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/aa-analyst-agent) |
| Toolathlon-Verified | 77.8 | Verified multi-tool workflows | Advanced tool use | [Kimi K3: Open Frontier Intelligence](https://www.kimi.com/blog/kimi-k3) |
| AutomationBench (Zapier 1.0.6) (AutomationBench, Zapier private evaluation set release 1.0.6) | 44.70 | 600+ held-out workflows across 47 simulated applications and six business domains | Long-horizon automation | [AutomationBench](https://arxiv.org/abs/2604.18934) |
| Hermes Index (Hermes Index: agentic capability and cost per task inside Hermes Agent) | 53.1 | Four suites: Hermes Bench (150 tasks), TerminalBench 4 without its 4 GPU tasks, TerminalBench Science and SkillsBench | Frontier agentic | [Hermes Index: an agentic model leaderboard](https://portal.nousresearch.com/bench) |
| Hermes Bench (Hermes Bench: 150 agent tasks graded on the files and state the agent leaves behind) | 73.5 | 150 tasks across 25 categories | Frontier agentic | [Hermes Bench (Hermes Index)](https://portal.nousresearch.com/bench) |
| MazeBench (MazeBench: visual spatial reasoning in a 3D open world) | 8 | 100 hidden gems across 256 rooms in one open world | Long-horizon spatial planning, with single puzzles that can take over one hundred moves | [MazeBench Results](https://mazebench.com/blog?post=maze-bench-results) |

### Multimodal & Grounded

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| Chartography (no tools) (Chartography without tools) | 61.6 | 100 specialized chart types | Professional chart reasoning | [Chartography](https://surgehq.ai/blog/chartography) |
| Chartography (tools) (Chartography with image and code tools) | 90.2 | 100 specialized chart types | Professional chart reasoning | [Chartography](https://surgehq.ai/blog/chartography) |
| BenchCAD Vision2Code (no tools) (BenchCAD Vision2Code voxel IoU without tools) | 0.747 | 1,000-file Vision2Code subset | Programmatic CAD generation | [BenchCAD: A comprehensive, industry-standard benchmark for programmatic CAD](https://arxiv.org/abs/2605.10865) |
| BenchCAD Vision2Code (tools) (BenchCAD Vision2Code voxel IoU with tools) | 0.963 | 1,000-file Vision2Code subset | Programmatic CAD generation | [BenchCAD: A comprehensive, industry-standard benchmark for programmatic CAD](https://arxiv.org/abs/2605.10865) |
| OfficeQA | 76.9 | Historical Treasury Bulletin questions | Professional document reasoning | [Claude Opus 5 System Card](https://www-cdn.anthropic.com/c5fbac3f0b1280a933ebd26d3cb8bb9f5bdeaf48/Claude%20Opus%205%20System%20Card.pdf) |
| Design Arena Website (Design Arena Website Elo) | 1324 | Website generation comparisons | Design and website generation | [OpenRouter Grok 4.3 benchmarks](https://openrouter.ai/x-ai/grok-4.3/benchmarks) |
| OfficeQA Pro | 65.6 | Document and spreadsheet tasks | Enterprise grounded reasoning | [OfficeQA Pro: An Enterprise Benchmark for End-to-End Grounded Reasoning](https://arxiv.org/abs/2603.08655) |
| Biomedical image analysis (Anthropic biomedical-image-analysis evaluation) | 72.2 | 91 cases across 31 biomedical imaging tasks | Biomedical image analysis | [Claude Opus 5.5 System Card](https://www-cdn.anthropic.com/fc1b44717c85dc068bc6ba5024219938094694bd/Claude%20Opus%205.5%20System%20Card.pdf) |
| ParseBench (ParseBench: document parsing for AI agents (LlamaIndex leaderboard)) | 70.18 | 2,078 human-verified enterprise pages from insurance, finance and government documents | No method is strong on all five dimensions; charts and visual grounding separate the field | [ParseBench: A Document Parsing Benchmark for AI Agents](https://arxiv.org/abs/2604.08538) |
| ExtractBench (LlamaIndex) (ExtractBench: schema-guided enterprise document extraction (LlamaIndex leaderboard)) | 94.68 | 370 documents, 4,869 pages, 8 business domains, 67 document types, each with a JSON Schema | Short documents are near solved; long record lists and grounding separate systems | [ExtractBench: A Benchmark for Schema-Guided Enterprise Document Extraction](https://arxiv.org/abs/2607.29677) |
| ExtractBench Pro (ExtractBench Pro: long-tail document extraction challenges (LlamaIndex)) | 32 | 100 synthetic documents, 2,622 pages, 86 document types, six challenge groups | The best system completes 58 of 100 documents perfectly; several complete none | [ExtractBench Pro leaderboard and challenge descriptions](https://www.extractbench.ai/pro) |

## Lifecycle and limitations log

Lifecycle events the source associates with this model.

| Event | Type | Confirmation | Announced | Effective | Replacement | Source |
| --- | --- | --- | --- | --- | --- | --- |
| Claude Sonnet 5.5 | Release | confirmed | Unavailable | 2026-09-28 | — | [Anthropic Claude Sonnet 5.5 announcement](https://www.anthropic.com/claude-sonnet-5-5) |

## What this profile does not claim

Values are reproduced exactly as their sources published them, in the units those sources declared; none are converted, interpolated, or averaged across providers. Any field marked unavailable was attempted and not returned. Last attempted fetch for this model's score: 2026-10-23 13:17 UTC.