Massively Multitask Language Understanding on AfriMMLU (test)
34.2Accuracy (Xho)Llama-3.1-70B-Instruct
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Llama-3.1-70B-InstructSize=70B2026.03 | 34.2 | 40.4 | 39 | 76.4 | |
| Aya-101Size=13B2026.03 | 32.2 | 31.2 | 33.2 | 42.8 | |
| Llama-3.1-8B-InstructSize=8B2026.03 | 27.2 | 31.8 | 31.8 | 62.8 | |
| AfroLlama-V1Size=8B2026.03 | 26.6 | 27.1 | 26 | 34 | |
| InkubaLM-0.4BSize=0.4B2026.03 | 26.2 | 23.4 | 26.6 | 24.3 | |
| MzansiLMVariant=general-ft, Size=0.125B2026.03 | 23 | 24.2 | 25.1 | 23.4 | |
| MzansiLMVariant=Base 0-shot, Size=0.125B2026.03 | 22.7 | 24.7 | 23.7 | 25.4 |