external benchmark
SRE-Bench leaderboard
SRE-Bench binary reverse engineering. Every model the catalog carries a published SRE-Bench value for, ranked by that value.
A contamination-controlled benchmark that asks agents to reverse engineer compiled binaries without source access and satisfy six task-specific objectives per challenge.
SRE-Bench ranking
1 model with a published SRE-Bench value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.
| Rank | Model | Provider | Fully solved challenge rate (pass@1) |
|---|---|---|---|
| 1 |  GPT-6 Astra | OpenAI | 88.0 |
Evidence key: Observed
Rows are ordered by the value GPT-6 Astra System Card published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.