Categoryexternal
MeasureCharacter-name answer accuracy by context length
Tasks58 question-needle pairs; five haystacks; 26 placements through 32K
Selected author accuracy curves for long-context retrieval with minimal wording overlap. Original NoLiMa stays separate from Hard, and 64K/128K use fewer placements. The displayed score is 32K accuracy, outside overall and category rankings.
No model in the catalog has a published NoLiMa score.The benchmark is defined by NoLiMa: Long-Context Evaluation Beyond Literal Matching, but the catalog carries no value for it yet. An absent value is shown as absent here rather than as a zero.
About NoLiMa
What the benchmark measures and how its value is published, from the source’s own record.
What is NoLiMa?
NoLiMa (NoLiMa original-task reports) is an external benchmark published by NoLiMa: Long-Context Evaluation Beyond Literal Matching. Selected author accuracy curves for long-context retrieval with minimal wording overlap. Original NoLiMa stays separate from Hard, and 64K/128K use fewer placements. The displayed score is 32K accuracy, outside overall and category rankings. Its evaluation set is described by the source as 58 question-needle pairs; five haystacks; 26 placements through 32K.
How is NoLiMa scored?
Each model's result is published by NoLiMa: Long-Context Evaluation Beyond Literal Matching as character-name answer accuracy by context length. ModelScale prints that value to 1 decimal place, exactly as published, and never converts or rescales it. This page ranks the 0 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.
ModelScale