Mathematical Reasoning on AfriMGSM (test)
18.8Accuracy (Xho)Llama-3.1-70B-Instruct
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Llama-3.1-70B-InstructSize=70B2026.03 | 18.8 | 27.2 | 32.8 | 86.8 | |
| InkubaLM-0.4BSize=0.4B2026.03 | 9.2 | 9.2 | 2.4 | 12 | |
| Llama-3.1-8B-InstructSize=8B2026.03 | 4.4 | 5.2 | 6.4 | 56.8 | |
| Aya-101Size=13B2026.03 | 4.4 | 4.8 | 10.8 | 11.6 | |
| MzansiLMVariant=general-ft, Size=0.125B2026.03 | 2.4 | 0.8 | 1.6 | 1.6 | |
| MzansiLMVariant=Base 0-shot, Size=0.125B2026.03 | 1.6 | 2.4 | 1.2 | 0.8 | |
| AfroLlama-V1Size=8B2026.03 | 0 | 0.4 | 0.8 | 0.4 |