Machine Translation Evaluation on MSLC OOD 24
73.79MT Empty ScoreXCOMET
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| XCOMETreference used=true2025.12 | 73.79 | 64.12 | 82.04 | 85.65 | 71.77 | 20.31 | |
| COMET-22reference used=true2025.12 | 57 | 58.81 | 69.85 | 67.84 | 65.56 | 45.23 | |
| KIWIreference used=false2025.12 | 54.87 | 67.72 | 52.15 | 82.64 | 78.75 | 41.95 | |
| GEMBA-ESAreference used=false2025.12 | 14 | 13.5 | 11.12 | 14.32 | 18.08 | 1.27 | |
| ReMedy-R-7Breference used=true2025.12 | 1 | 7.07 | 76.92 | 43.69 | 60.6 | 1.5 | |
| ReMedy-R-7Breference used=false2025.12 | 0.83 | 5.4 | 90.38 | 33.15 | 65.4 | 2 | |
| ReMedy-R-14Breference used=true2025.12 | 0 | 0 | 11.35 | 14.6 | 37.6 | 0.6 | |
| ReMedy-R-14Breference used=false2025.12 | 0 | 0 | 28.07 | 12.1 | 35.5 | 1 | |
| ReMedy-R-32Breference used=true2025.12 | 0 | 0 | 2.76 | 8.3 | 46 | 1.3 | |
| ReMedy-R-32Breference used=false2025.12 | 0 | 0 | 1.3 | 8 | 43.8 | 3.5 | |
| MetricX-24-XXLreference used=false2025.12 | -7.34 | -5.85 | -11.36 | -2.51 | -7.78 | -24.25 | |
| MetricX-24-XXLreference used=true2025.12 | -9.59 | -5.85 | -12.59 | -3.06 | -10.08 | -24.15 |