CategoryKnowledge
MeasureAccuracy without tools, highest available reasoning effort
Tasks1,000 expert questions: 500 reasoning and 500 knowledge
DifficultyFrontier expert knowledge and reasoning
Accuracy on the 1,000-question HLE-Diamond set without tools at each model's highest available reasoning effort.
No model in the catalog has a published HLE-Diamond (highest effort) score.The benchmark is defined by Introducing HLE-Diamond, but the catalog carries no value for it yet. An absent value is shown as absent here rather than as a zero.
About HLE-Diamond (highest effort)
What the benchmark measures and how its value is published, from the source’s own record.
What is HLE-Diamond (highest effort)?
HLE-Diamond (highest effort) (Humanity's Last Exam Diamond without tools at highest reasoning effort) is a knowledge benchmark published by Introducing HLE-Diamond. Accuracy on the 1,000-question HLE-Diamond set without tools at each model's highest available reasoning effort. Its evaluation set is described by the source as 1,000 expert questions: 500 reasoning and 500 knowledge. The source rates its difficulty as frontier expert knowledge and reasoning.
How is HLE-Diamond (highest effort) scored?
Each model's result is published by Introducing HLE-Diamond as accuracy without tools, highest available reasoning effort. ModelScale prints that value to 1 decimal place, exactly as published, and never converts or rescales it. This page ranks the 0 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.
ModelScale