Instruction Following benchmark
MultiChallenge (provider reports) leaderboard
MultiChallenge: provider-reported runs. Every model the catalog carries a published MultiChallenge (provider reports) value for, ranked by that value.
CategoryInstruction Following
Tests instruction retention, memory of user information, versioned editing, and coherence over multi-turn conversations.
MultiChallenge (provider reports) ranking
1 model with a published MultiChallenge (provider reports) value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.
Models ranked by their published MultiChallenge: provider-reported runs value| Rank | Model | Provider | MultiChallenge (provider reports) |
|---|
| 1 |  Mercury 3 | Inception | 60.35 |
Evidence key: Observed
Rows are ordered by the value MultiChallenge published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
About MultiChallenge (provider reports)
What the benchmark measures and how its value is published, from the source’s own record.
What is MultiChallenge (provider reports)?
MultiChallenge (provider reports) (MultiChallenge: provider-reported runs) is an instruction following benchmark published by MultiChallenge. Tests instruction retention, memory of user information, versioned editing, and coherence over multi-turn conversations.
How is MultiChallenge (provider reports) scored?
One value per model is published by MultiChallenge. ModelScale prints that value to 2 decimal places, exactly as published, and never converts or rescales it. This page ranks the 1 model that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.
ModelScale