Coding benchmark
Senior SWE-Bench leaderboard
Every model the catalog carries a published Senior SWE-Bench value for, ranked by that value.
CategoryCoding
MeasureAgentic software-engineering evaluation
TasksSenior-level repository tasks
DifficultyProfessional senior engineering
Published bySenior SWE-Bench
A Snorkel AI benchmark of senior-level software engineering tasks emphasizing under-specified feature work, bug/performance investigation, and taste-based correctness.
No model in the catalog has a published Senior SWE-Bench score.
The benchmark is defined by Senior SWE-Bench, but the catalog carries no value for it yet. An absent value is shown as absent here rather than as a zero.