Mathematical Reasoning on GSM8K (Multilingual Breakdown)
51.7Accuracy (ar)RA-MoE
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| RA-MoEModel=Qwen1.52026.05 | 51.7 | 32.5 | 59.2 | 59.1 | 45.8 | 60.3 | |
| RISEModel=Qwen1.52026.05 | 50.1 | 30.6 | 57.5 | 57.7 | 43.4 | 59 | |
| SFTModel=Qwen1.52026.05 | 48.8 | 29.5 | 56.7 | 57.2 | 42.3 | 58.5 | |
| RA-MoEModel=DSV22026.05 | 39 | 20.7 | 65.2 | 59.9 | 51.6 | 64.3 | |
| RISEModel=DSV22026.05 | 37.9 | 19.9 | 64.4 | 58.9 | 50.3 | 63.6 | |
| SFTModel=DSV22026.05 | 37.6 | 19.4 | 64.2 | 58.6 | 50 | 63.4 | |
| RSModel=Qwen1.52026.05 | 29.5 | 4.1 | 29.4 | 41.3 | 9.9 | 45.1 | |
| 0-shotModel=Qwen1.52026.05 | 29.3 | 3.2 | 28.8 | 41.8 | 9.4 | 44.4 | |
| RSModel=DSV22026.05 | 26.4 | 11.6 | 63.1 | 59.3 | 44.2 | 61.7 | |
| 0-shotModel=DSV22026.05 | 26 | 10.2 | 63.7 | 58.7 | 43.7 | 61.4 | |
| RA-MoEModel=OLMoE2026.05 | 10.4 | 2.2 | 22.5 | 26.5 | 15.2 | 29.2 | |
| RISEModel=OLMoE2026.05 | 9.7 | 2 | 21.7 | 25.7 | 14.2 | 28.1 | |
| SFTModel=OLMoE2026.05 | 9.4 | 2.2 | 21.3 | 25.7 | 13.8 | 28.3 | |
| RSModel=OLMoE2026.05 | 5.1 | 2 | 18.6 | 21.3 | 6.8 | 23.6 | |
| 0-shotModel=OLMoE2026.05 | 3.8 | 1.9 | 17.7 | 20.7 | 7.2 | 23 |