Machine Translation on WMT En-Fr 14 (BLEU)
45.4BLEUFinetuned SOTA
Evaluation Results
| Method | Links | |
|---|---|---|
| Finetuned SOTASetting=Supervised2022.08 | 45.4 | |
| mRASP2020.10 | 44.3 | |
| PaLM 540BSetting=Few-shot, Model Size=540B, Shot Count=52022.08 | 42.8 | |
| Direct2020.10 | 41.4 | |
| PaLM 540BSetting=0-shot, Model Size=540B2022.08 | 41.1 | |
| mBART2020.10 | 41 | |
| GPT3 175BSetting=Few-shot, Model Size=175B, Shot Count=642022.08 | 39.2 | |
| AlexaTM 20BSetting=Few-shot, Model Size=20B, Shot Count=32*2022.08 | 38.38 | |
| PaLM 540BSetting=1-shot, Model Size=540B2022.08 | 37.4 | |
| GPT3 175BSetting=1-shot, Model Size=175B2022.08 | 33.7 | |
| XGLM 7.5BSetting=Few-shot, Model Size=7.5B2022.08 | 33.2 | |
| AlexaTM 20BSetting=1-shot, Model Size=20B2022.08 | 31.76 | |
| Adapter SoupBackbone=Qwen-2.5-7B2025.11 | 30.4 | |
| LOGO (Norm)Backbone=Qwen-2.5-7B2025.11 | 30.4 | |
| LoRA RetrieverBackbone=Qwen-2.5-7B2025.11 | 30.3 | |
| LOGO (Entropy)Backbone=Qwen-2.5-7B2025.11 | 30.3 | |
| Adapter SoupBackbone=LLaMA-3.1-8B2025.11 | 29.5 | |
| AlexaTM 20BSetting=0-shot, Model Size=20B2022.08 | 29.24 | |
| LoRA RetrieverBackbone=LLaMA-3.1-8B2025.11 | 28.7 | |
| LOGO (Norm)Backbone=LLaMA-3.1-8B2025.11 | 28.6 | |
| LOGO (Entropy)Backbone=LLaMA-3.1-8B2025.11 | 28.6 | |
| BaseBackbone=Qwen-2.5-7B2025.11 | 28.5 | |
| BaseBackbone=LLaMA-3.1-8B2025.11 | 27.7 | |
| Adapter SoupBackbone=DeepSeek-LLM-7B-Base2025.11 | 27.7 | |
| LoRA RetrieverBackbone=DeepSeek-LLM-7B-Base2025.11 | 27.2 | |
| LoRAHubBackbone=LLaMA-3.1-8B2025.11 | 27.1 | |
| LOGO (Norm)Backbone=DeepSeek-LLM-7B-Base2025.11 | 27 | |
| LOGO (Entropy)Backbone=DeepSeek-LLM-7B-Base2025.11 | 26.5 | |
| BaseBackbone=DeepSeek-LLM-7B-Base2025.11 | 26 | |
| LoRAHubBackbone=DeepSeek-LLM-7B-Base2025.11 | 25.4 | |
| GPT3 175BSetting=0-shot, Model Size=175B2022.08 | 21.2 | |
| LoRAHubBackbone=Qwen-2.5-7B2025.11 | 6 |