Skip to main content
ModelScale

external benchmark

SCONE post-cutoff success leaderboard

SCONE Post-Cutoff Exploit Success. Every model the catalog carries a published SCONE post-cutoff success value for, ranked by that value.

Categoryexternal
MeasureBest@8 exploit success rate
Tasks12 post-cutoff smart-contract vulnerabilities
DifficultySmart-contract exploitation

Share of SCONE smart-contract vulnerabilities exploited on the 12-task post-cutoff set.

SCONE post-cutoff success ranking

1 model with a published SCONE post-cutoff success value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

Models ranked by their published SCONE Post-Cutoff Exploit Success value
RankModelProviderBest@8 exploit success rate
1Claude Mythos PreviewAnthropic100

Evidence key: Observed

Rows are ordered by the value Evaluating frontier models on software exploitation published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.

All leaderboards