Machine Translation on WMT de-en (BLEU, COMET)
33.87BLEUGPT-4
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GPT-4Evaluation Protocol=zero-shot2023.09 | 33.87 | 85.62 | |
| GPT-3.5-TEvaluation Protocol=zero-shot2023.09 | 33.1 | 85.5 | |
| ALMA-13B-LoRABackbone=LLaMA-2, Backbone Size=13B, Evaluation Protocol=LoRA2023.09 | 31.14 | 84.56 | |
| LLaMA-2-13BBackbone Size=13B, Evaluation Protocol=zero-shot2023.09 | 31.06 | 83.01 | |
| GPT-3.5-DEvaluation Protocol=zero-shot2023.09 | 30.9 | 84.79 | |
| ALMA-13BBackbone=LLaMA-2, Backbone Size=13B2023.09 | 30.73 | 84.42 | |
| SWIE-LLaMA-1-7BBackbone=LLaMA-1, Backbone Size=7B2023.09 | 30.48 | 82.97 | |
| LLaMA-2-7BBackbone Size=7B, Evaluation Protocol=zero-shot2023.09 | 30.42 | 82.74 | |
| ALMA-7B-LoRABackbone=LLaMA-2, Backbone Size=7B, Evaluation Protocol=LoRA2023.09 | 29.56 | 83.95 | |
| ALMA-7BBackbone=LLaMA-2, Backbone Size=7B2023.09 | 29.49 | 83.98 | |
| TIM-LLaMA-1-7BBackbone=LLaMA-1, Backbone Size=7B2023.09 | 27.91 | 82.8 | |
| Bayling-13BBackbone Size=13B2023.09 | 27.34 | 83.02 | |
| NLLB-54BBackbone=NLLB-200, Backbone Size=54B2023.09 | 26.89 | 78.94 | |
| SWIE-BLOOMZ-7BBackbone=BLOOMZ, Backbone Size=7B2023.09 | 25.95 | 78.8 | |
| TIM-BLOOMZ-7BBackbone=BLOOMZ, Backbone Size=7B2023.09 | 24.31 | 77.65 | |
| BigTranslate-13BBackbone Size=13B2023.09 | 23.35 | 80.68 |