# CharXiv leaderboard

Multimodal & Grounded benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/leaderboards/benchmarks/multimodal-grounded-charxiv

CharXiv Reasoning. Every model the catalog carries a published CharXiv value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Multimodal & Grounded |
| Measure | Chart understanding and reasoning |
| Tasks | Scientific chart reasoning |
| Difficulty | Scientific visualization reasoning |
| Published by | [CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs](https://charxiv.github.io/) |

A scientific chart reasoning benchmark that tests whether models can understand, interpret, and reason about complex scientific visualizations including plots, diagrams, and data charts.

## CharXiv ranking

52 models with a published CharXiv value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Chart understanding and reasoning | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [Claude Mythos 5](https://modelscale.dev/models/claude-mythos-5) | Anthropic | 93.5 | Observed 2026-11-21 · source benchlm:models |
| 1 | [Qwen3.8 Max](https://modelscale.dev/models/qwen3-8-max) | Alibaba | 93.5 | Observed 2026-11-21 · source benchlm:models |
| 3 | [Kimi K3.1 Pro](https://modelscale.dev/models/kimi-3-1-pro) | Moonshot AI | 93.4 | Observed 2026-11-21 · source benchlm:models |
| 4 | [Glimpse](https://modelscale.dev/models/glimpse) | Elorian | 92.9 | Observed 2026-11-21 · source benchlm:models |
| 5 | [Qwen3.8-Omni-Flash](https://modelscale.dev/models/qwen3-8-omni-flash) | Alibaba | 91.4 | Observed 2026-11-21 · source benchlm:models |
| 6 | [Kimi K3](https://modelscale.dev/models/kimi-3) | Moonshot AI | 91.3 | Observed 2026-11-21 · source benchlm:models |
| 7 | [Claude Opus 4.7](https://modelscale.dev/models/claude-opus-4-7) | Anthropic | 91 | Observed 2026-11-21 · source benchlm:models |
| 7 | [Claude Opus 4.7 (Adaptive)](https://modelscale.dev/models/claude-opus-4-7-max) | Anthropic | 91 | Last good 2026-11-18 · source benchlm:models |
| 9 | [Qwen3.8-Flash-Next](https://modelscale.dev/models/qwen3-8-flash-next) | Alibaba | 90.6 | Observed 2026-11-21 · source benchlm:models |
| 10 | [LongCat-2.5](https://modelscale.dev/models/longcat-2-5) | Meituan | 90.2 | Observed 2026-11-21 · source benchlm:models |
| 10 | [Qwen3.8-27B](https://modelscale.dev/models/qwen3-8-27b) | Alibaba | 90.2 | Observed 2026-11-21 · source benchlm:models |
| 12 | [Claude Opus 4.8](https://modelscale.dev/models/claude-opus-4-8) | Anthropic | 89.9 | Observed 2026-11-21 · source benchlm:models |
| 13 | [GLM-5.3-Flash](https://modelscale.dev/models/glm-5-3-flash) | Z.AI | 89.4 | Observed 2026-11-21 · source benchlm:models |
| 14 | [Gemini 3.7 Flash](https://modelscale.dev/models/gemini-3-7-flash) | Google | 88.7 | Observed 2026-11-21 · source benchlm:models |
| 15 | [Muse Spark 1.1](https://modelscale.dev/models/muse-spark-1-1) | Meta | 88.4 | Observed 2026-11-21 · source benchlm:models |
| 16 | [Claude Sonnet 5](https://modelscale.dev/models/claude-sonnet-5) | Anthropic | 88.3 | Observed 2026-11-21 · source benchlm:models |
| 16 | [Inkling 2 Mini](https://modelscale.dev/models/inkling-2-mini) | Thinking Machines Lab | 88.3 | Observed 2026-11-21 · source benchlm:models |
| 18 | [Inkling 2 Small](https://modelscale.dev/models/inkling-2-small) | Thinking Machines Lab | 87.7 | Observed 2026-11-21 · source benchlm:models |
| 19 | [Sakana Fugu-Ultra](https://modelscale.dev/models/sakana-fugu-ultra) | Sakana AI | 86.6 | Observed 2026-11-21 · source benchlm:models |
| 20 | [Muse Spark](https://modelscale.dev/models/muse-spark) | Meta | 86.4 | Observed 2026-11-21 · source benchlm:models |
| 21 | [Qwen3.7 Plus](https://modelscale.dev/models/qwen3-7-plus) | Alibaba | 85.9 | Observed 2026-11-21 · source benchlm:models |
| 22 | [Seed 2.1 Pro](https://modelscale.dev/models/seed-2-1-pro) | ByteDance | 85.4 | Observed 2026-11-21 · source benchlm:models |
| 23 | [Sakana Fugu](https://modelscale.dev/models/sakana-fugu) | Sakana AI | 85.1 | Observed 2026-11-21 · source benchlm:models |
| 24 | [Gemini 3.5 Flash](https://modelscale.dev/models/gemini-3-5-flash) | Google | 84.2 | Observed 2026-11-21 · source benchlm:models |
| 25 | [GPT-5.4](https://modelscale.dev/models/gpt-5-4) | OpenAI | 82.8 | Observed 2026-11-21 · source benchlm:models |
| 26 | [MiniMax M3.1 Flash](https://modelscale.dev/models/minimax-m3-1-flash) | MiniMax | 82.5 | Observed 2026-11-21 · source benchlm:models |
| 26 | [Seed 2.1 Turbo](https://modelscale.dev/models/seed-2-1-turbo) | ByteDance | 82.5 | Observed 2026-11-21 · source benchlm:models |
| 28 | [GPT-5.2](https://modelscale.dev/models/gpt-5-2) | OpenAI | 82.1 | Observed 2026-11-21 · source benchlm:models |
| 29 | [Inkling](https://modelscale.dev/models/inkling) | Thinking Machines Lab | 82 | Observed 2026-11-21 · source benchlm:models |
| 30 | [Qwen3.6 Plus](https://modelscale.dev/models/qwen3-6-plus) | Alibaba | 81.5 | Observed 2026-11-21 · source benchlm:models |
| 31 | [Gemini 3 Pro](https://modelscale.dev/models/gemini-3-pro) | Google | 81.4 | Observed 2026-11-21 · source benchlm:models |
| 32 | [Inkling-Small](https://modelscale.dev/models/inkling-small) | Thinking Machines Lab | 81.3 | Observed 2026-11-21 · source benchlm:models |
| 33 | [MiMo-V2.5](https://modelscale.dev/models/mimo-v2-5) | Xiaomi | 81 | Observed 2026-11-21 · source benchlm:models |
| 34 | [Nemotron 3.5 Super VL 120B A12B](https://modelscale.dev/models/nemotron-3-5-super-vl-120b-a12b) | NVIDIA | 80.82 | Observed 2026-11-21 · source benchlm:models |
| 35 | [Qwen3.5 397B](https://modelscale.dev/models/qwen3-5-397b) | Alibaba | 80.8 | Observed 2026-11-21 · source benchlm:models |
| 36 | [Kimi K2.6](https://modelscale.dev/models/kimi-2-6) | Moonshot AI | 80.4 | Observed 2026-11-21 · source benchlm:models |
| 37 | [Gemini 3.1 Pro](https://modelscale.dev/models/gemini-3-1-pro) | Google | 80.2 | Observed 2026-11-21 · source benchlm:models |
| 38 | [Nemotron 3.5 Super VL 120B A12B NVFP4](https://modelscale.dev/models/nemotron-3-5-super-vl-120b-a12b-nvfp4) | NVIDIA | 79.88 | Observed 2026-11-21 · source benchlm:models |
| 39 | [Qwen3.5-27B](https://modelscale.dev/models/qwen3-5-27b) | Alibaba | 79.5 | Observed 2026-11-21 · source benchlm:models |
| 40 | [Muse Glimmer 30B](https://modelscale.dev/models/muse-glimmer-30b) | Meta | 78.8 | Observed 2026-11-21 · source benchlm:models |
| 41 | [Qwen3.6-27B](https://modelscale.dev/models/qwen3-6-27b) | Alibaba | 78.4 | Observed 2026-11-21 · source benchlm:models |
| 42 | [Qwen3.6-35B-A3B](https://modelscale.dev/models/qwen3-6-35b-a3b) | Alibaba | 78 | Observed 2026-11-21 · source benchlm:models |
| 43 | [Kimi K2.5](https://modelscale.dev/models/kimi-k2-5) | Moonshot AI | 77.5 | Observed 2026-11-21 · source benchlm:models |
| 43 | [Kimi K2.5 (Reasoning)](https://modelscale.dev/models/kimi-k2-5-reasoning) | Moonshot AI | 77.5 | Last good 2026-11-18 · source benchlm:models |
| 43 | [Qwen3.5-35B-A3B](https://modelscale.dev/models/qwen3-5-35b-a3b) | Alibaba | 77.5 | Observed 2026-11-21 · source benchlm:models |
| 46 | [Claude Sonnet 4.6](https://modelscale.dev/models/claude-sonnet-4-6) | Anthropic | 77.4 | Observed 2026-11-21 · source benchlm:models |
| 47 | [Qwen3.5-122B-A10B](https://modelscale.dev/models/qwen3-5-122b-a10b) | Alibaba | 77.2 | Observed 2026-11-21 · source benchlm:models |
| 48 | [Nemotron 3 Nano Omni 30B A3B](https://modelscale.dev/models/nemotron-3-nano-omni-30b-a3b) | NVIDIA | 76.25 | Observed 2026-11-21 · source benchlm:models |
| 49 | [Gemini 3.1 Flash-Lite](https://modelscale.dev/models/gemini-3-1-flash-lite) | Google | 73.2 | Observed 2026-11-21 · source benchlm:models |
| 50 | [Claude Opus 4.5](https://modelscale.dev/models/claude-opus-4-5) | Anthropic | 68.5 | Observed 2026-11-21 · source benchlm:models |
| 51 | [Grok 4.20](https://modelscale.dev/models/grok-4-20-beta) | xAI | 60.9 | Observed 2026-11-21 · source benchlm:models |
| 52 | [Command A+](https://modelscale.dev/models/command-a-plus) | Cohere | 52.7 | Observed 2026-11-21 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
