Glossing on Multilingual held-out (test)
0.152Morpheme Error Rate (arp)POLYGLOSS
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| POLYGLOSSBackbone=ByT5, Interleaved training=true2026.01 | 0.152 | 0.072 | 0.597 | 0.16 | 0.095 | 0.357 | 0.142 | 0.222 | 0.306 | 0.234 | |
| GLOSSLM2026.01 | 0.161 | 0.095 | 0.87 | 0.163 | 0.909 | 0.94 | 0.893 | 0.99 | 0.731 | 0.639 | |
| Gemma 3Model size=4B, In-Context Learning (ICL)=true2026.01 | 0.489 | 0.597 | 0.826 | 0.476 | 0.351 | 0.668 | 0.473 | 0.43 | 0.723 | 0.559 | |
| Aya ExpanseModel size=8B, In-Context Learning (ICL)=true2026.01 | 0.545 | 0.749 | 0.871 | 0.514 | 0.464 | 0.74 | 0.591 | 0.492 | 0.802 | 0.641 | |
| Qwen 3Model size=0.6B, In-Context Learning (ICL)=true2026.01 | 0.868 | 0.904 | 0.919 | 0.73 | 0.773 | 0.895 | 0.877 | 0.706 | 0.883 | 0.839 |