Intent Classification on INJONGO Intent
84.7Accuracy (Eng)Llama-3.1-70B-Instruct
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Llama-3.1-70B-InstructSize=70B2026.03 | 84.7 | 34.3 | 35.2 | 23.3 | |
| AfroXLMR-largeSize=0.550B2026.03 | 84.5 | 96.9 | 97.7 | 86.8 | |
| AfroXLMR-baseSize=0.270B2026.03 | 84.1 | 97.3 | 96.1 | 85.5 | |
| AfriBERTaSize=0.126B2026.03 | 74.2 | 94.4 | 95 | 81.9 | |
| Aya-101Size=13B2026.03 | 70.7 | 62.7 | 57.2 | 45.9 | |
| AfroLlama-V1Size=8B2026.03 | 10.1 | 1.8 | 1 | 0.1 | |
| MzansiLM general-ftSize=0.125B, Evaluation Protocol=general-ft2026.03 | 3.5 | 0.6 | 0.6 | 0.9 | |
| MzansiLM mono-injongo-intent-ftSize=0.125B, Evaluation Protocol=mono-injongo-intent-ft2026.03 | 3.4 | 0.6 | 0.6 | 0.9 | |
| MzansiLM Base 0-shotSize=0.125B, Evaluation Protocol=0-shot2026.03 | 3.1 | 0.8 | 0.9 | 1.4 | |
| MzansiLM multi-injongo-intent-ftSize=0.125B, Evaluation Protocol=multi-injongo-intent-ft2026.03 | 2.9 | 1 | 0.7 | 0.7 | |
| InkubaLM-0.4BSize=0.4B2026.03 | 0.4 | 0.3 | 0.3 | 0.3 |