external benchmark

SimpleQA Verified (Kaggle) leaderboard

SimpleQA Verified (Kaggle benchmark v1). Every model the catalog carries a published SimpleQA Verified (Kaggle) value for, ranked by that value.

Categoryexternal

MeasureTask score (%)

Tasks1,000 verified short-form factual prompts; task version 7

Published bySimpleQA Verified

Kaggle's continuously updated SimpleQA Verified board, with 56 configurations against the 13 rows transcribed from the author paper.

No model in the catalog has a published SimpleQA Verified (Kaggle) score.

The benchmark is defined by SimpleQA Verified, but the catalog carries no value for it yet. An absent value is shown as absent here rather than as a zero.

About SimpleQA Verified (Kaggle)

What the benchmark measures and how its value is published, from the source’s own record.

What is SimpleQA Verified (Kaggle)?

SimpleQA Verified (Kaggle) (SimpleQA Verified (Kaggle benchmark v1)) is an external benchmark published by SimpleQA Verified. Kaggle's continuously updated SimpleQA Verified board, with 56 configurations against the 13 rows transcribed from the author paper. Its evaluation set is described by the source as 1,000 verified short-form factual prompts; task version 7.

How is SimpleQA Verified (Kaggle) scored?

Each model's result is published by SimpleQA Verified as task score (%). ModelScale prints that value to 1 decimal place, exactly as published, and never converts or rescales it. This page ranks the 0 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.

All leaderboards

Explore models

Top 1-5

Top 6-10

Featured

Capabilities

Benchmarks

Compare

Featured model comparisons

Featured provider comparisons

Articles