# Pencil Puzzle Bench leaderboard

Reasoning benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/leaderboards/benchmarks/reasoning-pp-bench

Every model the catalog carries a published Pencil Puzzle Bench value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Reasoning |
| Measure | Direct and agentic puzzle solve rate |
| Tasks | 300 evaluation puzzles |
| Difficulty | Multi-step verifiable reasoning |
| Published by | [Pencil Puzzle Bench](https://arxiv.org/abs/2603.02119) |

A multi-step verifiable reasoning benchmark that evaluates whether models can solve pencil puzzles with unique solutions.

## Pencil Puzzle Bench ranking

No model in the catalog has a published Pencil Puzzle Bench score. The benchmark is defined by Pencil Puzzle Bench, but the catalog carries no value for it yet. An absent value is shown as absent here rather than as a zero.

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
