Named Entity Recognition on XTREME-UP low-resource languages (test)
81.5F1 ScoreByT5
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| ByT5Evaluation Protocol=Fine-tuned, Inference Time (ms)=13.82024.03 | 81.5 | — | — | — | — | — | — | — | — | |
| MyT5Evaluation Protocol=Fine-tuned, Inference Time (ms)=12.62024.03 | 80.8 | — | — | — | — | — | — | — | — | |
| mT5Evaluation Protocol=In-context-learning2024.03 | 74 | — | — | — | — | — | — | — | — | |
| Flan-PaLMEvaluation Protocol=In-context-learning2024.03 | 12 | — | — | — | — | — | — | — | — | |
| mBERTVocabulary Expansion=none2026.02 | — | 0 | 48.39 | — | 50.95 | — | 0 | 13.48 | 22.56 | |
| Proposed methodVocabulary Expansion=proposed vocabulary expanding2026.02 | — | 42.15 | 50.92 | — | 62.88 | — | 25.44 | 36.68 | 43.61 | |
| Random initializationVocabulary Expansion=random initialization2026.02 | — | 41.04 | 49.08 | — | 56.2 | — | 25 | 33.72 | 41.01 |