# ExtractBench Pro leaderboard

Multimodal & Grounded benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/leaderboards/benchmarks/multimodal-grounded-extract-bench-pro

ExtractBench Pro: long-tail document extraction challenges (LlamaIndex). Every model the catalog carries a published ExtractBench Pro value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Multimodal & Grounded |
| Measure | Perfect-document rate, value F1, word and page grounding F1 and cost, overall and per challenge |
| Tasks | 100 synthetic documents, 2,622 pages, 86 document types, six challenge groups |
| Difficulty | The best system completes 58 of 100 documents perfectly; several complete none |
| Published by | [ExtractBench Pro leaderboard and challenge descriptions](https://www.extractbench.ai/pro) |

A harder companion to ExtractBench: 100 synthetic documents and 2,622 pages across 86 document types that test document conventions, house vocabulary, counting rules, drawn relations and charts, scored by perfect-document rate.

## ExtractBench Pro ranking

5 models with a published ExtractBench Pro value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Perfect-document rate, value F1, word and page grounding F1 and cost, overall and per challenge | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [GPT-6 Astra](https://modelscale.dev/models/gpt-6-astra) | OpenAI | 58 | Observed 2026-10-23 · source benchlm:models |
| 2 | [Claude Opus 5.5](https://modelscale.dev/models/claude-opus-5-5) | Anthropic | 51 | Observed 2026-10-23 · source benchlm:models |
| 3 | [Claude Sonnet 5.5](https://modelscale.dev/models/claude-sonnet-5-5) | Anthropic | 32 | Observed 2026-10-23 · source benchlm:models |
| 4 | [GPT-6.1 Sol](https://modelscale.dev/models/gpt-6-1-sol) | OpenAI | 12 | Observed 2026-10-23 · source benchlm:models |
| 5 | [GPT-6 Luna](https://modelscale.dev/models/gpt-6-luna) | OpenAI | 0 | Observed 2026-10-23 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.