Dialect Robustness on EN
57Success RatemT5
Evaluation results
| Method | Links | |
|---|---|---|
| mT5Model Scale=XXL, Training Variant=-NANO2022.11 | 57 | |
| mT5Model Scale=XXL, Training Variant=+NANO2022.11 | 57 | |
| mT5Model Scale=XL, Training Variant=-NANO2022.11 | 55 | |
| mT5Model Scale=XL, Training Variant=+NANO2022.11 | 54 | |
| BLEURTMetric Category=Learned2022.11 | 53 | |
| YiSiMetric Category=Lexical2022.11 | 53 | |
| PRISMMetric Category=Learned2022.11 | 51 | |
| mT5Model Scale=base, Training Variant=-NANO2022.11 | 50 | |
| mT5Model Scale=base, Training Variant=+NANO2022.11 | 50 | |
| BLEUMetric Category=Lexical2022.11 | 49 | |
| CHRFMetric Category=Lexical2022.11 | 46 |