Machine Translation on FLORES drop perturbation (test)
-68.01Average ErrorOPUS
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| OPUSBeam size=52024.03 | -68.01 | — | — | — | — | -67.77 | -63.3 | -71.31 | -69.66 | |
| OPUS2024.03 | -49.1 | -47.8 | -59.4 | -27.9 | -61.4 | — | — | — | — | |
| NLLB2024.03 | -29.3 | -30.7 | -33.7 | -16.6 | -36.2 | — | — | — | — | |
| NLLBBeam size=52024.03 | -21.26 | — | — | — | — | -22.65 | -22.23 | -18.45 | -21.71 | |
| TI2024.03 | -20.4 | -21.9 | -23.5 | -13.7 | -22.6 | — | — | — | — | |
| TIBeam size=52024.03 | -14 | — | — | — | — | -17.22 | -15 | -9.08 | -14.68 | |
| GPT-3.52024.03 | -12 | -12 | -13.4 | -9.6 | -12.8 | — | — | — | — | |
| GPT-3.5Temperature=02024.03 | -6.81 | — | — | — | — | -6.59 | -7.32 | -6.72 | -6.63 |