Headline Generation on AfriHG isiXhosa
15.2chrFAya
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AyaSize=13B2026.03 | 15.2 | — | — | |
| AfriTeVa2 baseSize=0.313B2026.03 | 14.9 | — | — | |
| mT5-baseSize=0.58B2026.03 | 12.7 | — | — | |
| MzansiLM (multi-afrihg-ft)Size=0.125B, Adaptation Approach=Multilingual task-specific finetuning2026.03 | 5.67 | 0.95 | 16.98 | |
| MzansiLM (mono-afrihg-ft)Size=0.125B, Adaptation Approach=Monolingual task-specific finetuning2026.03 | 4.47 | 0.63 | 14.28 | |
| MzansiLM (general-ft)Size=0.125B, Adaptation Approach=Multi-task instruction finetuning2026.03 | 4.1 | 0.36 | 12.42 | |
| MzansiLM (Base 0-shot)Size=0.125B, Adaptation Approach=0-shot2026.03 | 0.03 | 0 | 3.29 | |
| MzansiLM (Base 1-shot)Size=0.125B, Adaptation Approach=1-shot2026.03 | 0.03 | 0 | 4.08 | |
| MzansiLM (Base 3-shot)Size=0.125B, Adaptation Approach=3-shot2026.03 | 0 | 0 | 0.74 |