Topic Classification on SIB-200 (Eng, Xho, Zul, Sot, Nso, Afr)
84Accuracy (Xho)AfroXLMR-large
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| AfroXLMR-largeSize=0.550B2026.03 | 84 | — | 85.8 | 83.5 | 83.3 | 91.1 | |
| AfroXLMR-baseSize=0.270B2026.03 | 83.1 | — | 84.9 | 83.7 | 80.7 | 90.4 | |
| Aya-101Size=13B2026.03 | 82 | 82.8 | 82.9 | 81.4 | 82.1 | 83.7 | |
| AfriBERTaSize=0.126B2026.03 | 70.7 | — | 73.5 | 55.9 | 54.8 | 89.8 | |
| Llama-3.1-70B-InstructSize=70B2026.03 | 65 | 88.3 | 57.3 | 54.4 | 55.8 | 85.6 | |
| MzansiLM multi-sib200-ftSize=0.125B, Evaluation Protocol=multi-sib200-ft2026.03 | 40.4 | 33.3 | 47.2 | 34.7 | 30.5 | 29.6 | |
| MzansiLM mono-sib200-ftSize=0.125B, Evaluation Protocol=mono-sib200-ft2026.03 | 39.1 | 28 | 22 | 36.8 | 36.6 | 54.4 | |
| MzansiLM general-ftSize=0.125B, Evaluation Protocol=general-ft2026.03 | 39.1 | 28 | 47.2 | 36.8 | 33.9 | 54.4 | |
| MzansiLM Base 0-shotSize=0.125B, Evaluation Protocol=0-shot2026.03 | 28.9 | 32.3 | 31.2 | 18 | 17.3 | 43.4 | |
| InkubaLM-0.4BSize=0.4B2026.03 | 8.4 | 9 | 8.2 | 5.3 | 6.4 | 5.3 | |
| AfroLlama-V1Size=8B2026.03 | 6.5 | 6.4 | 6.4 | 39.7 | 38.7 | 6.4 |