Quality Estimation on WMT 2020 (test)
71.8QE Score (en-cs)NANO
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| NANOsize=XXL, pretraining=true2022.11 | 71.8 | 57.6 | 46.6 | 66.3 | 51 | 38.5 | 70.4 | 58.8 | |
| NANOsize=XXL, pretraining=false2022.11 | 71.4 | 57.4 | 47.1 | 65.5 | 52.4 | 36.3 | 70.3 | 58.7 | |
| COMET2022.11 | 70.9 | 51.4 | 37.3 | 51.5 | 48.9 | 39.4 | 61.3 | 50.3 | |
| NANOsize=XL, pretraining=true2022.11 | 69.5 | 53.8 | 42.7 | 62.6 | 47.1 | 31.5 | 68.4 | 54.8 | |
| NANOsize=XL, pretraining=false2022.11 | 68.7 | 51.4 | 40.6 | 59.6 | 44.3 | 28.2 | 66.3 | 51.8 | |
| Prism2022.11 | 48.3 | — | 26.5 | 38.2 | 18.8 | 11.6 | — | 11.3 |