# IDE-Bench leaderboard

Coding benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/leaderboards/benchmarks/coding-ide-bench

Every model the catalog carries a published IDE-Bench value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Coding |
| Measure | Autonomous IDE-agent task completion (pass@1) |
| Tasks | 80 tasks across 8 repositories |
| Difficulty | End-to-end software engineering |
| Published by | [IDE-Bench](https://arxiv.org/abs/2601.20886) |

An 80-task software-engineering benchmark across eight repositories that tests whether autonomous IDE agents can explore, edit, run, and verify code changes end to end.

## IDE-Bench ranking

No model in the catalog has a published IDE-Bench score. The benchmark is defined by IDE-Bench, but the catalog carries no value for it yet. An absent value is shown as absent here rather than as a zero.

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
