Machine Translation on FLORES en->xx (test)
47.8Score (en->de)GPT-3.5
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GPT-3.5Metric=BLEU, nrefs=1, case=mixed, eff=no, tok=flores200, smooth=exp, version=2.5.12024.03 | 47.8 | 56.6 | 25.6 | 56.6 | 46.7 | |
| TIMetric=BLEU, nrefs=1, case=mixed, eff=no, tok=flores200, smooth=exp, version=2.5.12024.03 | 47 | 57.1 | 29.5 | 52.8 | 46.6 | |
| NLLBMetric=BLEU, nrefs=1, case=mixed, eff=no, tok=flores200, smooth=exp, version=2.5.12024.03 | 46.8 | 56.2 | 24.8 | 54.5 | 45.6 | |
| OPUSMetric=BLEU, nrefs=1, case=mixed, eff=no, tok=flores200, smooth=exp, version=2.5.12024.03 | 42 | 55.6 | 23.8 | 54.6 | 44 | |
| GPT-3.5Temperature=02024.03 | -1.14 | -1.32 | -1.42 | -0.98 | -1.21 | |
| TIBeam size=52024.03 | -2.4 | -1.79 | -1.39 | -1.89 | -1.87 | |
| NLLBBeam size=52024.03 | -4.04 | -3.81 | -2.79 | -4.13 | -3.69 | |
| OPUSBeam size=52024.03 | -54.9 | -46.25 | -65.86 | -57.94 | -56.24 |