Grapheme-to-Phoneme on SIGMORPHON 2020 (test)
13.8WERByT5
Evaluation results
| Method | Links | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ByT5Architecture=ByT5, Model Scale=XXL, Evaluation Protocol=Fine-tuning2021.05 | 13.8 | 1.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ByT5Architecture=ByT5, Model Scale=Base, Evaluation Protocol=Fine-tuning2021.05 | 14 | 1.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ByT5Architecture=ByT5, Model Scale=XL, Evaluation Protocol=Fine-tuning2021.05 | 14.7 | 1.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ByT5Architecture=ByT5, Model Scale=Small, Evaluation Protocol=Fine-tuning2021.05 | 14.8 | 1.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ByT5Architecture=ByT5, Model Scale=Large, Evaluation Protocol=Fine-tuning2021.05 | 15.4 | 1.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| mT5Architecture=mT5, Model Scale=XXL, Evaluation Protocol=Fine-tuning2021.05 | 40.1 | 5.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| mT5Architecture=mT5, Model Scale=XL, Evaluation Protocol=Fine-tuning2021.05 | 42 | 6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| mT5Architecture=mT5, Model Scale=Large, Evaluation Protocol=Fine-tuning2021.05 | 43.5 | 6.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| mT5Architecture=mT5, Model Scale=Base, Evaluation Protocol=Fine-tuning2021.05 | 46.2 | 7.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| mT5Architecture=mT5, Model Scale=Small, Evaluation Protocol=Fine-tuning2021.05 | 54 | 10.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DD-OSTIA2026.01 | — | — | 9.8 | 1.1 | 9.1 | 5.6 | 4.9 | 8 | 4.9 | 3.3 | 6.2 | 10 | 16.7 | 7.1 | 27.1 | 3.8 | 14 | |
| Neural Induction of Finite-State Transducers2026.01 | — | — | 20 | 14.9 | 58.9 | 59.6 | 23.6 | 30.7 | 18.4 | 5.7 | 27.8 | 41.1 | 17.1 | 36.9 | 59.8 | 23.3 | 52.2 | |
| OSTIA2026.01 | — | — | 4.7 | 0.9 | 6.7 | 1.3 | 3.8 | 8.7 | 1.3 | 2.9 | 2.9 | 2.9 | 14.4 | 2.9 | 29.8 | 2.2 | 5.3 |