Machine Translation on WMT en→cs (test)
0.376BLEUNLLB-54B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| NLLB-54BParameter Scale=54B2023.09 | 0.376 | 0.9015 | |
| GPT-4Zero-shot=true2023.09 | 0.3453 | 0.9077 | |
| GPT-3.5-TZero-shot=true, Version=turbo-03012023.09 | 0.3292 | 0.9017 | |
| ALMA-13B-LORABackbone=LLaMA-2, Parameter Scale=13B, Fine-tuning=LoRA2023.09 | 0.3238 | 0.8979 | |
| GPT-3.5-DZero-shot=true, Version=text-davinci-0032023.09 | 0.313 | 0.8857 | |
| ALMA-13BBackbone=LLaMA-2, Parameter Scale=13B2023.09 | 0.3112 | 0.8942 | |
| ALMA-7B-LORABackbone=LLaMA-2, Parameter Scale=7B, Fine-tuning=LoRA2023.09 | 0.3017 | 0.8905 | |
| ALMA-7BBackbone=LLaMA-2, Parameter Scale=7B2023.09 | 0.2988 | 0.891 | |
| BigTranslate-13BBackbone=LLaMA-1, Parameter Scale=13B2023.09 | 0.2067 | 0.8065 | |
| LLaMA-2-7BBackbone=LLaMA-2, Parameter Scale=7B, Zero-shot=true2023.09 | 0.1602 | 0.7913 | |
| LLaMA-2-13BBackbone=LLaMA-2, Parameter Scale=13B, Zero-shot=true2023.09 | 0.0087 | 0.6857 |