List your company
ResearchFormerly WizWand

Machine Translation on WMT En-Fr 14 (BLEU)

45.4BLEUFinetuned SOTA
4.42415.06225.736.338Oct 7, 2020Aug 13, 2021Jun 19, 2022Apr 25, 2023Feb 29, 2024Jan 4, 2025Nov 10, 2025
Updated 6mo ago

Evaluation results

MethodLinks
Finetuned SOTASetting=Supervised2022.0845.4
mRASP2020.1044.3
PaLM 540BSetting=Few-shot, Model Size=540B, Shot Count=52022.0842.8
Direct2020.1041.4
PaLM 540BSetting=0-shot, Model Size=540B2022.0841.1
mBART2020.1041
GPT3 175BSetting=Few-shot, Model Size=175B, Shot Count=642022.0839.2
AlexaTM 20BSetting=Few-shot, Model Size=20B, Shot Count=32*2022.0838.38
PaLM 540BSetting=1-shot, Model Size=540B2022.0837.4
GPT3 175BSetting=1-shot, Model Size=175B2022.0833.7
XGLM 7.5BSetting=Few-shot, Model Size=7.5B2022.0833.2
AlexaTM 20BSetting=1-shot, Model Size=20B2022.0831.76
Adapter SoupBackbone=Qwen-2.5-7B2025.1130.4
LOGO (Norm)Backbone=Qwen-2.5-7B2025.1130.4
LoRA RetrieverBackbone=Qwen-2.5-7B2025.1130.3
LOGO (Entropy)Backbone=Qwen-2.5-7B2025.1130.3
Adapter SoupBackbone=LLaMA-3.1-8B2025.1129.5
AlexaTM 20BSetting=0-shot, Model Size=20B2022.0829.24
LoRA RetrieverBackbone=LLaMA-3.1-8B2025.1128.7
LOGO (Norm)Backbone=LLaMA-3.1-8B2025.1128.6
LOGO (Entropy)Backbone=LLaMA-3.1-8B2025.1128.6
BaseBackbone=Qwen-2.5-7B2025.1128.5
BaseBackbone=LLaMA-3.1-8B2025.1127.7
Adapter SoupBackbone=DeepSeek-LLM-7B-Base2025.1127.7
LoRA RetrieverBackbone=DeepSeek-LLM-7B-Base2025.1127.2
LoRAHubBackbone=LLaMA-3.1-8B2025.1127.1
LOGO (Norm)Backbone=DeepSeek-LLM-7B-Base2025.1127
LOGO (Entropy)Backbone=DeepSeek-LLM-7B-Base2025.1126.5
BaseBackbone=DeepSeek-LLM-7B-Base2025.1126
LoRAHubBackbone=DeepSeek-LLM-7B-Base2025.1125.4
GPT3 175BSetting=0-shot, Model Size=175B2022.0821.2
LoRAHubBackbone=Qwen-2.5-7B2025.116