Machine Translation on WMT ru-en
43.51BLEUGPT-4
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GPT-4Evaluation Protocol=zero-shot2023.09 | 43.51 | 86.18 | |
| GPT-3.5-TEvaluation Protocol=zero-shot2023.09 | 42.4 | 86.1 | |
| ALMA-13BBackbone=LLaMA-2, Backbone Size=13B2023.09 | 40.37 | 85.09 | |
| ALMA-13B-LoRABackbone=LLaMA-2, Backbone Size=13B, Evaluation Protocol=LoRA2023.09 | 40.27 | 85.27 | |
| ALMA-7B-LoRABackbone=LLaMA-2, Backbone Size=7B, Evaluation Protocol=LoRA2023.09 | 39.21 | 84.84 | |
| NLLB-54BBackbone=NLLB-200, Backbone Size=54B2023.09 | 39.11 | 81.88 | |
| ALMA-7BBackbone=LLaMA-2, Backbone Size=7B2023.09 | 38.93 | 84.81 | |
| GPT-3.5-DEvaluation Protocol=zero-shot2023.09 | 38.5 | 84.8 | |
| LLaMA-2-13BBackbone Size=13B, Evaluation Protocol=zero-shot2023.09 | 36.5 | 82.91 | |
| LLaMA-2-7BBackbone Size=7B, Evaluation Protocol=zero-shot2023.09 | 36.02 | 82.84 | |
| Bayling-13BBackbone Size=13B2023.09 | 33.95 | 82.07 | |
| BigTranslate-13BBackbone Size=13B2023.09 | 26.81 | 77.8 |