Natural Language Understanding on FunGLUE noised (test)
74.37BoolQ AccPhonetic ByT5
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Phonetic ByT5Model=ByT5, Pre-training Task=Phoneme Prediction2023.07 | 74.37 | 87.5 | 85.46 | 66 | 33.26 | 75.15 | 70.21 | 70.88 | 76.17 | 66.77 | |
| ByT5Model=ByT52023.07 | 74.04 | 80.36 | 73.67 | 58 | 32.42 | 72.73 | 67.54 | 68.19 | 70.4 | 66.46 | |
| ByT5 - NeuSpellModel=ByT5, Spell Correction=NeuSpell2023.07 | 72.84 | 76.79 | 67.86 | 54 | 32.53 | 72.47 | 63.64 | 64.25 | 69.68 | 66.46 | |
| Phonetic mT5Model=mT5, Pre-training Task=Phoneme Prediction2023.07 | 71.8 | 80.36 | 73.66 | 53 | 25.81 | 72.2 | 55.85 | 56.86 | 61.37 | 63.17 | |
| ByT5 - Bert-L mask predModel=ByT5, Spell Correction=Bert-Large mask prediction2023.07 | 70.52 | 75 | 70.7 | 55 | 26.76 | 68.6 | 59.75 | 60.35 | 64.62 | 64.26 | |
| mT5Model=mT52023.07 | 68.81 | 80.36 | 74.21 | 55 | 28.23 | 70.37 | 58.46 | 59.46 | 67.87 | 63.64 | |
| mT5 - NeuSpellModel=mT5, Spell Correction=NeuSpell2023.07 | 67.92 | 76.79 | 74.99 | 64 | 30.43 | 70.85 | 60.36 | 61.33 | 65.34 | 65.83 | |
| mT5 - Bert-L mask predModel=mT5, Spell Correction=Bert-Large mask prediction2023.07 | 66.42 | 71.43 | 79.6 | 57 | 27.7 | 67.91 | 55.6 | 56.63 | 58.84 | 62.54 |