Dialect Robustness on ZH
74Success RatemT5
Evaluation Results
| Method | Links | |
|---|---|---|
| mT5Model Scale=XXL, Training Variant=-NANO2022.11 | 74 | |
| mT5Model Scale=XXL, Training Variant=+NANO2022.11 | 74 | |
| BLEURTMetric Category=Learned2022.11 | 59 | |
| mT5Model Scale=XL, Training Variant=+NANO2022.11 | 59 | |
| mT5Model Scale=XL, Training Variant=-NANO2022.11 | 51 | |
| PRISMMetric Category=Learned2022.11 | 47 | |
| YiSiMetric Category=Lexical2022.11 | 46 | |
| mT5Model Scale=base, Training Variant=-NANO2022.11 | 46 | |
| mT5Model Scale=base, Training Variant=+NANO2022.11 | 45 | |
| CHRFMetric Category=Lexical2022.11 | 36 | |
| BLEUMetric Category=Lexical2022.11 | 35 |