CategoryAgentic
MeasureMean pass@1 score across four suites, with mean cost per task
TasksFour suites: Hermes Bench (150 tasks), TerminalBench 4 without its 4 GPU tasks, TerminalBench Science and SkillsBench
DifficultyFrontier agentic
An index of agentic capability from Nous Research. It averages pass@1 scores on four suites, Hermes Bench, TerminalBench 4, TerminalBench Science and SkillsBench, with every run inside the Hermes Agent harness, and reports the mean cost per task beside the score.
About Hermes Index
What the benchmark measures and how its value is published, from the source’s own record.
What is Hermes Index?
Hermes Index (Hermes Index: agentic capability and cost per task inside Hermes Agent) is an agentic benchmark published by Hermes Index: an agentic model leaderboard. An index of agentic capability from Nous Research. It averages pass@1 scores on four suites, Hermes Bench, TerminalBench 4, TerminalBench Science and SkillsBench, with every run inside the Hermes Agent harness, and reports the mean cost per task beside the score. Its evaluation set is described by the source as four suites: Hermes Bench (150 tasks), TerminalBench 4 without its 4 GPU tasks, TerminalBench Science and SkillsBench. The source rates its difficulty as frontier agentic.
How is Hermes Index scored?
Each model's result is published by Hermes Index: an agentic model leaderboard as mean pass@1 score across four suites, with mean cost per task. ModelScale prints that value to 1 decimal place, exactly as published, and never converts or rescales it. This page ranks the 17 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.
ModelScale
