Skip to main content
ModelScale

Multilingual benchmark

Long-context translation leaderboard

Long-context translation evaluation (Cohere). Every model the catalog carries a published Long-context translation value for, ranked by that value.

CategoryMultilingual
MeasurexCOMET-XL quality score
TasksTwo book chapters per call
DifficultyLong-document translation

Cohere's long-document translation evaluation: two book chapters translated in a single call, scored per paragraph with xCOMET-XL.

Long-context translation ranking

1 model with a published Long-context translation value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

Models ranked by their published Long-context translation evaluation (Cohere) value
RankModelProviderxCOMET-XL quality score
1North Small TranslateCohere48.9

Evidence key: Observed

Rows are ordered by the value Introducing North Small Translate published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.

All leaderboards