Multilingual Mathematical Reasoning on MGSM8KInstruct (test)
47.6Accuracy (En)LM Base Model
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| LM Base ModelLM Component=Included, Math Component=Excluded, Merging Method=None2025.02 | 47.6 | 16 | 34.8 | 22.4 | 34.8 | 26.4 | 34.8 | 23.2 | 34.4 | 25.2 | 29.9 | |
| Math Base ModelLM Component=Excluded, Math Component=Included, Merging Method=None2025.02 | 43.2 | 2.8 | 13.2 | 12.8 | 21.2 | 30.8 | 20.4 | 10 | 18.4 | 12.8 | 18.5 | |
| LED-MergingLM Component=Included, Math Component=Included2025.02 | 36.8 | 7.6 | 27.2 | 24.8 | 20.4 | 22.4 | 18.4 | 18.8 | 21.2 | 16.4 | 21.3 | |
| Ties-MergingLM Component=Included, Math Component=Included2025.02 | 29.6 | 9.2 | 23.6 | 15.6 | 21.6 | 19.6 | 18.4 | 17.6 | 23.2 | 13.2 | 19.2 | |
| Task ArithmeticLM Component=Included, Math Component=Included2025.02 | 28 | 10 | 17.2 | 12.8 | 17.2 | 13.2 | 13.2 | 14.4 | 18 | 14 | 15.8 | |
| BreadcrumbsLM Component=Included, Math Component=Included2025.02 | 22.8 | 7.2 | 2.8 | 13.6 | 13.2 | 13.6 | 12.8 | 9.6 | 15.6 | 12 | 12.3 | |
| Model StockLM Component=Included, Math Component=Included2025.02 | 18 | 8.4 | 17.6 | 10 | 12.4 | 11.6 | 13.2 | 18.4 | 18.4 | 12 | 13.9 |