Machine Translation on WMT is-en
37.5BLEUGPT-3.5-T
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GPT-3.5-TEvaluation Protocol=zero-shot2023.09 | 37.5 | 85.5 | |
| ALMA-13B-LoRABackbone=LLaMA-2, Backbone Size=13B, Evaluation Protocol=LoRA2023.09 | 36.95 | 86.42 | |
| ALMA-13BBackbone=LLaMA-2, Backbone Size=13B2023.09 | 36.46 | 86.3 | |
| ALMA-7B-LoRABackbone=LLaMA-2, Backbone Size=7B, Evaluation Protocol=LoRA2023.09 | 35.64 | 86.09 | |
| ALMA-7BBackbone=LLaMA-2, Backbone Size=7B2023.09 | 35.26 | 85.97 | |
| GPT-3.5-DEvaluation Protocol=zero-shot2023.09 | 31.9 | 82.13 | |
| TIM-BLOOMZ-7BBackbone=BLOOMZ, Backbone Size=7B2023.09 | 23.42 | 79.5 | |
| SWIE-BLOOMZ-7BBackbone=BLOOMZ, Backbone Size=7B2023.09 | 23.4 | 79.36 | |
| NLLB-54BBackbone=NLLB-200, Backbone Size=54B2023.09 | 23.09 | 71.66 | |
| SWIE-LLaMA-1-7BBackbone=LLaMA-1, Backbone Size=7B2023.09 | 21.3 | 76.48 | |
| TIM-LLaMA-1-7BBackbone=LLaMA-1, Backbone Size=7B2023.09 | 19.33 | 75.46 | |
| LLaMA-2-13BBackbone Size=13B, Evaluation Protocol=zero-shot2023.09 | 15.77 | 66.35 | |
| LLaMA-2-7BBackbone Size=7B, Evaluation Protocol=zero-shot2023.09 | 10.98 | 62.79 | |
| BigTranslate-13BBackbone Size=13B2023.09 | 6.51 | 54.71 |