List your company
ResearchFormerly WizWand

Machine Translation on WMT de-en (BLEU, COMET)

33.87BLEUGPT-4
22.929225.769628.6131.4504Sep 20, 2023
Updated 8mo ago

Evaluation results

MethodLinks
GPT-4Evaluation Protocol=zero-shot2023.0933.8785.62
GPT-3.5-TEvaluation Protocol=zero-shot2023.0933.185.5
ALMA-13B-LoRABackbone=LLaMA-2, Backbone Size=13B, Evaluation Protocol=LoRA2023.0931.1484.56
LLaMA-2-13BBackbone Size=13B, Evaluation Protocol=zero-shot2023.0931.0683.01
GPT-3.5-DEvaluation Protocol=zero-shot2023.0930.984.79
ALMA-13BBackbone=LLaMA-2, Backbone Size=13B2023.0930.7384.42
SWIE-LLaMA-1-7BBackbone=LLaMA-1, Backbone Size=7B2023.0930.4882.97
LLaMA-2-7BBackbone Size=7B, Evaluation Protocol=zero-shot2023.0930.4282.74
ALMA-7B-LoRABackbone=LLaMA-2, Backbone Size=7B, Evaluation Protocol=LoRA2023.0929.5683.95
ALMA-7BBackbone=LLaMA-2, Backbone Size=7B2023.0929.4983.98
TIM-LLaMA-1-7BBackbone=LLaMA-1, Backbone Size=7B2023.0927.9182.8
Bayling-13BBackbone Size=13B2023.0927.3483.02
NLLB-54BBackbone=NLLB-200, Backbone Size=54B2023.0926.8978.94
SWIE-BLOOMZ-7BBackbone=BLOOMZ, Backbone Size=7B2023.0925.9578.8
TIM-BLOOMZ-7BBackbone=BLOOMZ, Backbone Size=7B2023.0924.3177.65
BigTranslate-13BBackbone Size=13B2023.0923.3580.68