Multilingual benchmark
Long-context translation leaderboard
Long-context translation evaluation (Cohere). Every model the catalog carries a published Long-context translation value for, ranked by that value.
Cohere's long-document translation evaluation: two book chapters translated in a single call, scored per paragraph with xCOMET-XL.
Long-context translation ranking
1 model with a published Long-context translation value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.
| Rank | Model | Provider | xCOMET-XL quality score |
|---|---|---|---|
| 1 | Cohere | 48.9 |
Evidence key: Observed
Rows are ordered by the value Introducing North Small Translate published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.