Categoryexternal
MeasurePass@1
Tasks100 source-reported tasks
DifficultySource-specific evaluation
Synthesizing information across long collections of documents. This table shows Mercor-run configurations for reference and is excluded from model rankings.
No model in the catalog has a published Long Context Reasoning (AA-LCR v1.1) (Mercor) score.The benchmark is defined by Long Context Reasoning (AA-LCR v1.1) evaluation results, but the catalog carries no value for it yet. An absent value is shown as absent here rather than as a zero.
About Long Context Reasoning (AA-LCR v1.1) (Mercor)
What the benchmark measures and how its value is published, from the source’s own record.
What is Long Context Reasoning (AA-LCR v1.1) (Mercor)?
Long Context Reasoning (AA-LCR v1.1) (Mercor) (Long Context Reasoning (AA-LCR v1.1) — Mercor evaluation) is an external benchmark published by Long Context Reasoning (AA-LCR v1.1) evaluation results. Synthesizing information across long collections of documents. This table shows Mercor-run configurations for reference and is excluded from model rankings. Its evaluation set is described by the source as 100 source-reported tasks. The source rates its difficulty as source-specific evaluation.
How is Long Context Reasoning (AA-LCR v1.1) (Mercor) scored?
Each model's result is published by Long Context Reasoning (AA-LCR v1.1) evaluation results as pass@1. ModelScale prints that value to 2 decimal places, exactly as published, and never converts or rescales it. This page ranks the 0 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.
ModelScale