Categoryexternal
MeasureAccuracy on the Perplexity fixed panel
Tasks11 decision task families
DifficultyDepends on the sampled tasks and label mapping
Perplexity reports accuracy across 11 decision tasks on a fixed 7,210-row panel. The overall percentage combines unequal task sample sizes, so a larger task contributes more than a smaller task.
Perplexity Decision Panel ranking
3 models with a published Perplexity Decision Panel value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.
About Perplexity Decision Panel
What the benchmark measures and how its value is published, from the source’s own record.
What is Perplexity Decision Panel?
Perplexity Decision Panel is an external benchmark published by Perplexity Decider v1 27B model card. Perplexity reports accuracy across 11 decision tasks on a fixed 7,210-row panel. The overall percentage combines unequal task sample sizes, so a larger task contributes more than a smaller task. Its evaluation set is described by the source as 11 decision task families. The source rates its difficulty as depends on the sampled tasks and label mapping.
How is Perplexity Decision Panel scored?
Each model's result is published by Perplexity Decider v1 27B model card as accuracy on the Perplexity fixed panel. ModelScale prints that value to 2 decimal places, exactly as published, and never converts or rescales it. This page ranks the 3 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.
ModelScale
