Categoryexternal
MeasureAccuracy
DifficultyTool-use decisions
When2Call is one component of the Artificial Analysis Decision Index v1.0, run by Artificial Analysis. It measures accuracy on NVIDIA's tool-calling evaluation: given a conversation and tools, choose to answer directly, call a tool, ask for more information, or decline.
When2Call (Decision Index) ranking
13 models with a published When2Call (Decision Index) value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.
About When2Call (Decision Index)
What the benchmark measures and how its value is published, from the source’s own record.
What is When2Call (Decision Index)?
When2Call (Decision Index) is an external benchmark published by Artificial Analysis Decision Index v1.0. When2Call is one component of the Artificial Analysis Decision Index v1.0, run by Artificial Analysis. It measures accuracy on NVIDIA's tool-calling evaluation: given a conversation and tools, choose to answer directly, call a tool, ask for more information, or decline. The source rates its difficulty as tool-use decisions.
How is When2Call (Decision Index) scored?
Each model's result is published by Artificial Analysis Decision Index v1.0 as accuracy. ModelScale prints that value to 1 decimal place, exactly as published, and never converts or rescales it. This page ranks the 13 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.
ModelScale
