Machine Translation Robustness on FLORES xx→en
-45.2de->en ScoreOPUS
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| OPUSNoise Type=swap2024.03 | -45.2 | -47.4 | -32.9 | -46 | -42.9 | |
| OPUSNoise Type=key2024.03 | -43.6 | -45.5 | -34.5 | -46 | -42.4 | |
| OPUSNoise Type=drop2024.03 | -40.1 | -39.7 | -29 | -38.7 | -36.9 | |
| TINoise Type=key2024.03 | -28.6 | -30.6 | -26.3 | -34.6 | -30 | |
| TINoise Type=swap2024.03 | -28.4 | -27.3 | -29 | -28.1 | -28.2 | |
| NLLBNoise Type=key2024.03 | -26.6 | -27.7 | -31 | -29.6 | -28.7 | |
| NLLBNoise Type=swap2024.03 | -25.3 | -26.6 | -27.7 | -26.4 | -26.5 | |
| NLLBNoise Type=drop2024.03 | -23.8 | -23.6 | -26.6 | -24.1 | -24.5 | |
| OPUSNoise Type=dupe2024.03 | -22.9 | -24.5 | -6.8 | -23.1 | -19.3 | |
| TINoise Type=drop2024.03 | -22.3 | -20.9 | -25.5 | -21.1 | -22.5 | |
| GPT-3.5Noise Type=key2024.03 | -12.1 | -11.9 | -22.6 | -14 | -15.2 | |
| GPT-3.5Noise Type=drop2024.03 | -10 | -9.3 | -26 | -10.4 | -13.9 | |
| NLLBNoise Type=dupe2024.03 | -7.6 | -8.6 | -6.1 | -7.5 | -7.4 | |
| GPT-3.5Noise Type=swap2024.03 | -7.1 | -9.6 | -29.2 | -10.9 | -14.2 | |
| TINoise Type=dupe2024.03 | -5.1 | -6.4 | -3.9 | -5.3 | -5.2 | |
| GPT-3.5Noise Type=dupe2024.03 | -2.7 | -2.7 | -10.2 | -2.8 | -4.6 |