# SWE-Bench Pro (Private Dataset) leaderboard

external benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/leaderboards/benchmarks/external-scale-swe-bench-pro-v1-private

Scale Labs SWE-Bench Pro (Private Dataset). Every model the catalog carries a published SWE-Bench Pro (Private Dataset) value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | external |
| Measure | Resolve rate (%) |
| Tasks | 14 published rows |
| Difficulty | External agent and model evaluation |
| Published by | [Scale Labs leaderboard](https://labs.scale.com/leaderboard/swe_bench_pro) |

Scale’s first SWE-Bench Pro leaderboard, with public and private (commercial) dataset lanes. Scale now publishes SWE-Bench Pro V2 on a separate board. BenchLM shows it as display-only reference data, excluded from rankings.

## SWE-Bench Pro (Private Dataset) ranking

No model in the catalog has a published SWE-Bench Pro (Private Dataset) score. The benchmark is defined by Scale Labs leaderboard, but the catalog carries no value for it yet. An absent value is shown as absent here rather than as a zero.

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
