Machine Translation Performance Prediction on FLORES-AE33 Type I (test)
1.8MAERT-SCORE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RT-SCOREMT System=MBART50-M2M, Translation Metric=BLEU2022.09 | 1.8 | 2.7 | 0.94 | |
| RT-SCOREMT System=MBART50-M2M, Translation Metric=spBLEU2022.09 | 2.13 | 2.99 | 0.94 | |
| RT-SCOREMT System=GOOGLE-TRANS, Translation Metric=BERTScore2022.09 | 2.87 | 3.66 | 0.8 | |
| RT-SCOREMT System=MBART50-M2M, Translation Metric=chrF2022.09 | 3.51 | 4.53 | 0.96 | |
| RT-SCOREMT System=M2M-100-BASE, Translation Metric=BLEU2022.09 | 3.86 | 5.82 | 0.95 | |
| RT-SCOREMT System=M2M-100-BASE, Translation Metric=spBLEU2022.09 | 3.97 | 5.72 | 0.96 | |
| RT-SCOREMT System=GOOGLE-TRANS, Translation Metric=BLEU2022.09 | 4.09 | 5.6 | 0.93 | |
| RT-SCOREMT System=GOOGLE-TRANS, Translation Metric=spBLEU2022.09 | 4.22 | 5.62 | 0.87 | |
| RT-SCOREMT System=M2M-100-BASE, Translation Metric=BERTScore2022.09 | 4.35 | 6.32 | 0.91 | |
| RT-SCOREMT System=MBART50-M2M, Translation Metric=BERTScore2022.09 | 4.98 | 7.07 | 0.88 | |
| RT-SCOREMT System=GOOGLE-TRANS, Translation Metric=chrF2022.09 | 5.7 | 6.9 | 0.93 | |
| RT-SCOREMT System=M2M-100-BASE, Translation Metric=chrF2022.09 | 6.06 | 7.53 | 0.96 |