FrontierSWE v2 (Mercor) leaderboard

FrontierSWE v2 (Mercor) (FrontierSWE v2 — Mercor evaluation) is an external benchmark published by FrontierSWE v2 evaluation results. Long engineering projects scored by continuous task-specific metrics. This table shows Mercor-run configurations for reference and is excluded from model rankings. Its evaluation set is described by the source as 34 source-reported tasks. The source rates its difficulty as source-specific evaluation.

Each model's result is published by FrontierSWE v2 evaluation results as mean Score. ModelScale prints that value to 2 decimal places, exactly as published, and never converts or rescales it. This page ranks the 0 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.