Natural Language Inference on AfriXNLI (test)
55.2Accuracy (Xho)Aya-101
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Aya-101Size=13B2026.03 | 55.2 | 55.3 | 54.7 | |
| AfroLlama-V1Size=8B2026.03 | 41.8 | 38.3 | 34.3 | |
| Llama-3.1-70B-InstructSize=70B2026.03 | 39.3 | 37 | 39 | |
| InkubaLM-0.4BSize=0.4B2026.03 | 34.3 | 34.2 | 33.5 | |
| Llama-3.1-8B-InstructSize=8B2026.03 | 34 | 34.7 | 34.8 | |
| MzansiLMVariant=general-ft, Size=0.125B2026.03 | 33.4 | 33.6 | 31.8 | |
| MzansiLMVariant=Base 0-shot, Size=0.125B2026.03 | 32.3 | 32 | 32.3 |