Categoryexternal
MeasureAccuracy on the Perplexity fixed panel
TasksResponse-pair judgment
DifficultyDepends on the sampled tasks and label mapping
Response-pair judgment on the 350-row sample in Perplexity's September 2026 decision panel. This is a sampled, provider-reported accuracy result with its own evaluation setup.
JudgeBench (Perplexity panel) ranking
3 models with a published JudgeBench (Perplexity panel) value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.
About JudgeBench (Perplexity panel)
What the benchmark measures and how its value is published, from the source’s own record.
What is JudgeBench (Perplexity panel)?
JudgeBench (Perplexity panel) is an external benchmark published by Perplexity Decider v1 27B model card. Response-pair judgment on the 350-row sample in Perplexity's September 2026 decision panel. This is a sampled, provider-reported accuracy result with its own evaluation setup. Its evaluation set is described by the source as response-pair judgment. The source rates its difficulty as depends on the sampled tasks and label mapping.
How is JudgeBench (Perplexity panel) scored?
Each model's result is published by Perplexity Decider v1 27B model card as accuracy on the Perplexity fixed panel. ModelScale prints that value to 2 decimal places, exactly as published, and never converts or rescales it. This page ranks the 3 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.
ModelScale
