Multilingual benchmark
MGSM leaderboard
Multilingual Grade School Math. Every model the catalog carries a published MGSM value for, ranked by that value.
CategoryMultilingual
MeasureMath word problems
Tasks250 problems × 11 languages
DifficultyGrade school math, multilingual
A multilingual benchmark that translates 250 grade school math problems from GSM8K into 10 typologically diverse languages: Bengali, German, Spanish, French, Japanese, Russian, Swahili, Telugu, Thai, and Chinese.
No model in the catalog has a published MGSM score.
The benchmark is defined by Language Models are Multilingual Chain-of-Thought Reasoners, but the catalog carries no value for it yet. An absent value is shown as absent here rather than as a zero.