Machine Translation on FLORES swap perturbation (test)
-72.14Average ScoreOPUS
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| OPUSBeam size=52024.03 | -72.14 | — | — | — | — | -72.01 | -69.59 | -73.99 | -72.97 | |
| OPUS2024.03 | -51.3 | -49.1 | -62.6 | -28.9 | -64.5 | — | — | — | — | |
| NLLB2024.03 | -30 | -31.2 | -33.8 | -18.1 | -37.1 | — | — | — | — | |
| NLLBBeam size=52024.03 | -22.04 | — | — | — | — | -23.33 | -22.75 | -19.68 | -22.41 | |
| TI2024.03 | -18.3 | -19.8 | -20.7 | -12.6 | -20 | — | — | — | — | |
| TIBeam size=52024.03 | -14.11 | — | — | — | — | -16.64 | -13.71 | -12.63 | -13.44 | |
| GPT-3.52024.03 | -7.3 | -7.8 | -9.3 | -7.1 | -5.1 | — | — | — | — | |
| GPT-3.5Temperature=02024.03 | -4.23 | — | — | — | — | -3.89 | -4.46 | -4.79 | -3.76 |