Multilingual Grade School Math on MGSM (Language Breakdown and Average)
58Accuracy (Bengali)SARA
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SARABackbone=Phi-3.5-MoE-instruct, Semantic Anchor=English2026.06 | 58 | 46 | 54 | 69.2 | 56.8 | |
| ShifConBackbone=Phi-3.5-MoE-instruct, Semantic Anchor=English2026.06 | 56.4 | 45.2 | 53.6 | 68 | 55.8 | |
| FFTBackbone=Phi-3.5-MoE-instruct, Semantic Anchor=English2026.06 | 54.8 | 44 | 55.6 | 66.4 | 55.2 | |
| AESBackbone=Phi-3.5-MoE-instruct, Semantic Anchor=English2026.06 | 53.2 | 42.4 | 52 | 65.6 | 53.3 | |
| Vanilla LMBackbone=Phi-3.5-MoE-instruct, Semantic Anchor=English2026.06 | 9.2 | 0 | 11.2 | 65.2 | 21.4 |