Categoryexternal
MeasureAverage F1
DifficultySafety classification
WildGuardTest is one component of the Artificial Analysis Decision Index v1.0, run by Artificial Analysis. It measures average F1 on Ai2's safety classification set: whether a request is harmful, whether a reply is a refusal, and whether that reply is harmful.
WildGuardTest (Decision Index) ranking
13 models with a published WildGuardTest (Decision Index) value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.
About WildGuardTest (Decision Index)
What the benchmark measures and how its value is published, from the source’s own record.
What is WildGuardTest (Decision Index)?
WildGuardTest (Decision Index) is an external benchmark published by Artificial Analysis Decision Index v1.0. WildGuardTest is one component of the Artificial Analysis Decision Index v1.0, run by Artificial Analysis. It measures average F1 on Ai2's safety classification set: whether a request is harmful, whether a reply is a refusal, and whether that reply is harmful. The source rates its difficulty as safety classification.
How is WildGuardTest (Decision Index) scored?
Each model's result is published by Artificial Analysis Decision Index v1.0 as average F1. ModelScale prints that value to 1 decimal place, exactly as published, and never converts or rescales it. This page ranks the 13 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.
ModelScale
