Decision Index Tools leaderboard

Decision Index Tools (Decision Index 0.4 Tools) is an external benchmark published by Decision Index leaderboard. Decision Index 0.4 publishes chance-corrected tools scores for 209 evaluated systems. Its evaluation set is described by the source as tools area of the Decision Index evaluation. The source rates its difficulty as tool-use and automation decision tasks.

Each model's result is published by Decision Index leaderboard as chance-corrected area score. ModelScale prints that value to 1 decimal place, exactly as published, and never converts or rescales it. This page ranks the 120 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.