Multimodal & Grounded benchmark
ZeroBench w/ Python leaderboard
ZeroBench_main with Python. Every model the catalog carries a published ZeroBench w/ Python value for, ranked by that value.
CategoryMultimodal & Grounded
MeasurePass@5
TasksVisual reasoning questions with Python
DifficultyTool-augmented visual reasoning
Published byKimi K3: Open Frontier Intelligence
A Python-assisted ZeroBench_main evaluation reported as pass@5.
ZeroBench w/ Python ranking
3 models with a published ZeroBench w/ Python value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.
| Rank | Model | Provider | Pass@5 |
|---|---|---|---|
| 1 |  DeepSeek V4.1 Flash | DeepSeek | 49.0 |
| 1 |  Qwen3.8 Max | Alibaba | 49.0 |
| 3 |  Kimi K3 | Moonshot AI | 41.0 |
Evidence key: Observed
Rows are ordered by the value Kimi K3: Open Frontier Intelligence published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.