Machine Translation Quality Estimation on WMT News 2020 (test)
0.7Kendall's tauX-Check
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| X-CheckNumber of honest competitors=42022.09 | 0.7 | 0.98 | — | 1.5 | 1 | |
| X-CheckNumber of honest competitors=52022.09 | 0.62 | 0.92 | — | 1.5 | 1 | |
| X-CheckNumber of honest competitors=42022.09 | 0.6 | 0.97 | 100 | 1 | — | |
| X-CheckNumber of honest competitors=42022.09 | 0.57 | 0.81 | — | — | — | |
| X-CheckNumber of honest competitors=32022.09 | 0.55 | 0.98 | — | 1.5 | 1 | |
| X-CheckNumber of honest competitors=52022.09 | 0.5 | 0.93 | 100 | 1 | — | |
| Sing-CheckNumber of honest competitors=52022.09 | 0.48 | 0.58 | — | — | — | |
| X-CheckNumber of honest competitors=32022.09 | 0.47 | 0.43 | — | — | — | |
| X-CheckNumber of honest competitors=52022.09 | 0.42 | 0.52 | — | — | — | |
| Sing-CheckNumber of honest competitors=42022.09 | 0.4 | 0.39 | 25 | 2.75 | — | |
| Sing-CheckNumber of honest competitors=42022.09 | 0.33 | 0.37 | — | — | — | |
| Sing-CheckNumber of honest competitors=32022.09 | 0.33 | 0.51 | 50 | 2 | — | |
| X-CheckNumber of honest competitors=32022.09 | 0.33 | 0.98 | 100 | 1 | — | |
| Sing-CheckNumber of honest competitors=52022.09 | 0.3 | 0.25 | 25 | 3.25 | — | |
| Sing-CheckNumber of honest competitors=32022.09 | 0.07 | 0.17 | — | — | — | |
| Sing-CheckNumber of honest competitors=42022.09 | -0.03 | -0.33 | — | 5.75 | 0 | |
| Sing-CheckNumber of honest competitors=52022.09 | -0.05 | -0.4 | — | 6.75 | 0 | |
| Sing-CheckNumber of honest competitors=32022.09 | -0.15 | -0.3 | — | 4.75 | 0 |