Reference-based Quality Estimation on WMT
57.6Overall Score (en-*)NANO
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| NANOBackbone=mT5-XXL2022.11 | 57.6 | 71.8 | 46.6 | 66.3 | 51 | 38.5 | 70.4 | 58.8 | |
| mT5 (Finetuning)Backbone=mT5-XXL, Training Strategy=Finetuning2022.11 | 57.4 | 71.4 | 47.1 | 65.5 | 52.4 | 36.3 | 70.3 | 58.7 | |
| NANOBackbone=mT5-XL2022.11 | 53.8 | 69.5 | 42.7 | 62.6 | 47.1 | 31.5 | 68.4 | 54.8 | |
| COMET2022.11 | 51.4 | 70.9 | 37.3 | 51.5 | 48.9 | 39.4 | 61.3 | 50.3 | |
| mT5 (Finetuning)Backbone=mT5-XL, Training Strategy=Finetuning2022.11 | 51.4 | 68.7 | 40.6 | 59.6 | 44.3 | 28.2 | 66.3 | 51.8 |