Dialect Robustness on PT
82Success RatemT5
Evaluation results
| Method | Links | |
|---|---|---|
| mT5Model Scale=XXL, Training Variant=-NANO2022.11 | 82 | |
| mT5Model Scale=XXL, Training Variant=+NANO2022.11 | 81 | |
| mT5Model Scale=XL, Training Variant=+NANO2022.11 | 65 | |
| BLEURTMetric Category=Learned2022.11 | 59 | |
| mT5Model Scale=XL, Training Variant=-NANO2022.11 | 57 | |
| PRISMMetric Category=Learned2022.11 | 53 | |
| mT5Model Scale=base, Training Variant=+NANO2022.11 | 44 | |
| mT5Model Scale=base, Training Variant=-NANO2022.11 | 39 | |
| YiSiMetric Category=Lexical2022.11 | 36 | |
| BLEUMetric Category=Lexical2022.11 | 35 | |
| CHRFMetric Category=Lexical2022.11 | 35 |