Skip to main content
ModelScale

Coding benchmark

Spider 2.0-Lite leaderboard

Every model the catalog carries a published Spider 2.0-Lite value for, ranked by that value.

CategoryCoding
MeasureExecution accuracy
TasksText-to-SQL queries
DifficultyEnterprise text-to-SQL

A text-to-SQL benchmark over realistic warehouse-scale schemas, reported by Interfaze for model comparison.

Spider 2.0-Lite ranking

1 model with a published Spider 2.0-Lite value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

Models ranked by their published Spider 2.0-Lite value
RankModelProviderExecution accuracy
1INInterfaze BetaInterfaze52.9

Evidence key: Observed

Rows are ordered by the value Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.

All leaderboards · Coding capability leaderboard