Named Entity Recognition on MasakhaNER 2.0
90.6Macro-F1 ScoreAfroXLMR-large
Evaluation results
| Method | Links | |||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AfroXLMR-largeSize=0.550B, Type=Encoder-Only2026.03 | 90.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AfroXLMR-baseSize=0.270B, Type=Encoder-Only2026.03 | 88.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AfriBERTaSize=0.126B, Type=Encoder-Only2026.03 | 81.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MzansiLMVariant=mono-masakhaner-ft, Size=0.125B, Evaluation Protocol=Monolingual task-specific finetuning2026.03 | 26.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MzansiLMVariant=multi-masakhaner-ft, Size=0.125B, Evaluation Protocol=Multilingual task-specific finetuning2026.03 | 22.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MzansiLMVariant=general-ft, Size=0.125B, Evaluation Protocol=Multi-task instruction finetuning2026.03 | 20.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Llama-3.1-70B-InstructSize=70B, Type=Decoder-Only2026.03 | 10.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AfroLlama-V1Size=8B, Type=Decoder-Only2026.03 | 3.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MzansiLMVariant=Base 0-shot, Size=0.125B, Evaluation Protocol=no finetuning and no in-context examples2026.03 | 0 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| InkubaLM-0.4BSize=0.4B, Type=Decoder-Only2026.03 | 0 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Aya-101Size=13B, Type=Encoder-Decoder2026.03 | 0 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Awesome-alignTransfer Approach=NLLB+Aligner2022.11 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 63.2 | |
| EasyProjectTransfer Approach=NLLB+Markers2022.11 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 64.3 | |
| GLINEREvaluation Protocol=Cross-lingual evaluation2024.11 | — | 28.85 | 34.71 | 64.64 | 30.58 | 42.04 | 36.08 | 45.04 | 48.59 | 39.04 | 30.96 | 48.52 | 39.96 | 34.37 | 58.06 | 39.83 | 28.54 | 36.27 | 29.25 | 5.06 | 28.34 | 37.44 | — | |
| IEPILEEvaluation Protocol=Cross-lingual evaluation2024.11 | — | 29 | 32.36 | 57.83 | 29.73 | 43.06 | 37.54 | 43.87 | 53.13 | 48.02 | 26.42 | 52.93 | 67.5 | 43.87 | 55.5 | 54.05 | 45.69 | 35.31 | 36.99 | 26.79 | 34.61 | 42.71 | — | |
| KnowCoder-XEvaluation Protocol=Cross-lingual evaluation2024.11 | — | 32.97 | 32.97 | 66.05 | 31.86 | 48.35 | 38.75 | 47.56 | 58.04 | 49.89 | 31.71 | 51.94 | 81.91 | 46.58 | 69.42 | 56.97 | 51.1 | 38.7 | 45.73 | 34.73 | 36.5 | 47.59 | — | |
| mDeBERTaTransfer Approach=Fine-tune_en2022.11 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 55 | |
| Ref.Transfer Approach=Fine-tune_en2022.11 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 56.9 | |
| XMITransfer Approach=NLLB+Markers2022.11 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 63.8 | |
| YAYI-UIEEvaluation Protocol=Cross-lingual evaluation2024.11 | — | 31.19 | 32.03 | 63.01 | 30.05 | 47.68 | 37.14 | 40.84 | 46.74 | 44.04 | 26.05 | 53.72 | 66.71 | 43.47 | 64.62 | 51.45 | 35.62 | 34.75 | 36.57 | 28.88 | 38.07 | 42.63 | — |