Segment-level Agreement on WMT 2020 (test)
73Agreement (en-cs)NANO
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| NANOModel size=XXL, Pretraining stage=Without (-)2022.11 | 73 | 58.6 | 47.9 | 66.3 | 54.1 | 38.7 | 72 | 58.1 | |
| NANOModel size=XXL, Pretraining stage=With (+)2022.11 | 72.4 | 58.3 | 47.1 | 66.3 | 53.6 | 39.4 | 72.2 | 56.9 | |
| BLEURT2022.11 | 70.8 | 55.2 | 45.3 | 63 | 51 | 36.8 | 67.9 | 51.6 | |
| NANOModel size=XL, Pretraining stage=With (+)2022.11 | 69.8 | 54.2 | 41.9 | 63.7 | 49.9 | 33.2 | 70.2 | 50.9 | |
| NANOModel size=XL, Pretraining stage=Without (-)2022.11 | 68.2 | 49.2 | 41 | 63 | 48.6 | 30.8 | 68.5 | 51 | |
| Prism2022.11 | 63.8 | — | 39.8 | 60.2 | 46 | 33.9 | — | 41.6 | |
| YiSi2022.11 | 50.1 | 35.6 | 32.7 | 44.8 | 21.7 | 24 | 35.7 | 40 |