# SWE Atlas - Codebase QnA Extended (Mercor) leaderboard

external benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/leaderboards/benchmarks/external-mercor-swe-atlas-qna-extended

SWE Atlas - Codebase QnA Extended — Mercor evaluation. Every model the catalog carries a published SWE Atlas - Codebase QnA Extended (Mercor) value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | external |
| Measure | Pass@1 |
| Tasks | 50 Mercor tasks; 124 tasks in the separately reported original set |
| Difficulty | Source-specific evaluation |
| Published by | [SWE Atlas - Codebase QnA Extended evaluation results](https://www.mercor.com/apex/mercor-extended/ots-held-out-swe-atlas-leaderboard/) |

Answering questions about software repositories with an agent. This table shows Mercor-run configurations for reference and is excluded from model rankings.

## SWE Atlas - Codebase QnA Extended (Mercor) ranking

No model in the catalog has a published SWE Atlas - Codebase QnA Extended (Mercor) score. The benchmark is defined by SWE Atlas - Codebase QnA Extended evaluation results, but the catalog carries no value for it yet. An absent value is shown as absent here rather than as a zero.

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.