# FACTS Multimodal leaderboard

external benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/leaderboards/benchmarks/external-facts-multimodal

Every model the catalog carries a published FACTS Multimodal value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | external |
| Measure | Rubric-judged answers about images |
| Tasks | About 1,500 image questions: 711 public and 811 held out |
| Difficulty | Image-grounded factual answering |
| Published by | [BenchLM](https://benchlm.ai/benchmarks/facts-multimodal) |

FACTS Multimodal checks whether a model answers a question about an image without leaving out essential facts or contradicting them. It is the image part of the FACTS suite.

## FACTS Multimodal ranking

23 models with a published FACTS Multimodal value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Rubric-judged answers about images | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [Gemini 4 Carbon](https://modelscale.dev/models/gemini-4-carbon) | Google | 60.2 | Observed 2026-11-21 · source benchlm:models |
| 2 | [Gemini 3.8 Flash](https://modelscale.dev/models/gemini-3-8-flash) | Google | 57.6 | Observed 2026-11-21 · source benchlm:models |
| 3 | [Claude Opus 5.5](https://modelscale.dev/models/claude-opus-5-5) | Anthropic | 56.4 | Observed 2026-11-21 · source benchlm:models |
| 4 | [GPT-6 Astra](https://modelscale.dev/models/gpt-6-astra) | OpenAI | 55.2 | Observed 2026-11-21 · source benchlm:models |
| 5 | [Gemini 4 Argon](https://modelscale.dev/models/gemini-4-argon) | Google | 54.2 | Observed 2026-11-21 · source benchlm:models |
| 6 | [Gemini 3.6 Flash](https://modelscale.dev/models/gemini-3-6-flash) | Google | 53.7 | Observed 2026-11-21 · source benchlm:models |
| 7 | [GPT-6.1 Sol](https://modelscale.dev/models/gpt-6-1-sol) | OpenAI | 52.6 | Observed 2026-11-21 · source benchlm:models |
| 8 | [Qwen3.8 Max](https://modelscale.dev/models/qwen3-8-max) | Alibaba | 51.5 | Observed 2026-11-21 · source benchlm:models |
| 9 | [Claude Sonnet 5.5](https://modelscale.dev/models/claude-sonnet-5-5) | Anthropic | 50.4 | Observed 2026-11-21 · source benchlm:models |
| 9 | [Gemini 3.1 Pro](https://modelscale.dev/models/gemini-3-1-pro) | Google | 50.4 | Observed 2026-11-21 · source benchlm:models |
| 11 | [Gemini 3 Flash](https://modelscale.dev/models/gemini-3-flash) | Google | 49.7 | Observed 2026-11-21 · source benchlm:models |
| 12 | [GPT-6.1 Terra](https://modelscale.dev/models/gpt-6-1-terra) | OpenAI | 48.8 | Observed 2026-11-21 · source benchlm:models |
| 13 | [GPT-5.6 Sol](https://modelscale.dev/models/gpt-5-6-sol) | OpenAI | 46.4 | Observed 2026-11-21 · source benchlm:models |
| 14 | [GPT-6 Sol](https://modelscale.dev/models/gpt-6-sol) | OpenAI | 43.9 | Observed 2026-11-21 · source benchlm:models |
| 15 | [Gemma 4 31B](https://modelscale.dev/models/gemma-4-31b) | Google | 42.3 | Observed 2026-11-21 · source benchlm:models |
| 16 | [Grok 4.7](https://modelscale.dev/models/grok-4-7) | xAI | 40.9 | Observed 2026-11-21 · source benchlm:models |
| 17 | [GPT-5.6 Terra](https://modelscale.dev/models/gpt-5-6-terra) | OpenAI | 39.9 | Observed 2026-11-21 · source benchlm:models |
| 18 | [Gemma 4 26B A4B](https://modelscale.dev/models/gemma-4-26b-a4b) | Google | 39.5 | Observed 2026-11-21 · source benchlm:models |
| 19 | [Grok 4.6](https://modelscale.dev/models/grok-4-6) | xAI | 39.3 | Observed 2026-11-21 · source benchlm:models |
| 20 | [Claude Haiku 5.5](https://modelscale.dev/models/claude-haiku-5-5) | Anthropic | 38.9 | Observed 2026-11-21 · source benchlm:models |
| 21 | [GPT-6 Luna](https://modelscale.dev/models/gpt-6-luna) | OpenAI | 38.7 | Observed 2026-11-21 · source benchlm:models |
| 22 | [GPT-5.6 Luna](https://modelscale.dev/models/gpt-5-6-luna) | OpenAI | 37.4 | Observed 2026-11-21 · source benchlm:models |
| 23 | [Gemini 3.5 Flash-Lite](https://modelscale.dev/models/gemini-3-5-flash-lite) | Google | 36.1 | Observed 2026-11-21 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
