Categoryexternal
MeasureHard-subset character-name answer accuracy
Tasks10 hardest question-needle pairs
Selected reasoning-model accuracy curves on the ten hardest NoLiMa question-needle pairs. Exact API snapshots and effort remain undisclosed. The displayed score is 32K accuracy; these reports stay outside overall and category rankings.
No model in the catalog has a published NoLiMa-Hard score.The benchmark is defined by NoLiMa: Long-Context Evaluation Beyond Literal Matching, but the catalog carries no value for it yet. An absent value is shown as absent here rather than as a zero.
About NoLiMa-Hard
What the benchmark measures and how its value is published, from the source’s own record.
What is NoLiMa-Hard?
NoLiMa-Hard (NoLiMa-Hard selected reports) is an external benchmark published by NoLiMa: Long-Context Evaluation Beyond Literal Matching. Selected reasoning-model accuracy curves on the ten hardest NoLiMa question-needle pairs. Exact API snapshots and effort remain undisclosed. The displayed score is 32K accuracy; these reports stay outside overall and category rankings. Its evaluation set is described by the source as 10 hardest question-needle pairs.
How is NoLiMa-Hard scored?
Each model's result is published by NoLiMa: Long-Context Evaluation Beyond Literal Matching as hard-subset character-name answer accuracy. ModelScale prints that value to 1 decimal place, exactly as published, and never converts or rescales it. This page ranks the 0 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.
ModelScale