List your company
ResearchFormerly WizWand

Machine Translation on Ru-En document-level

84.59d-COMETOurs
80.929281.879682.8383.7804Apr 8, 2025
Updated 8mo ago

Evaluation results

MethodLinks
OursBase Model=Mistral-Nemo-Instruct, Quality-aware fine-tuning=true2025.0484.59
Ours (-QA)Base Model=Mistral-Nemo-Instruct, Quality-aware fine-tuning=false2025.0483.89
SentRefine (sent)Base Model=Mistral-Nemo-Instruct2025.0483.87
Sent2Sent (tuned)Base Model=Mistral-Nemo-Instruct2025.0483.33
Sent2SentBase Model=Mistral-Nemo-Instruct2025.0482.86
OursBase Model=LLaMA-3-8B-Instruct, Quality-aware fine-tuning=true2025.0482.75
DocRefine (doc)Base Model=LLaMA-3-8B-Instruct2025.0482.73
SentRefine (sent)Base Model=LLaMA-3-8B-Instruct2025.0482.64
Ours (-QA)Base Model=LLaMA-3-8B-Instruct, Quality-aware fine-tuning=false2025.0482.63
Doc2DocBase Model=Mistral-Nemo-Instruct2025.0482.6
Doc2Doc (tuned)Base Model=Mistral-Nemo-Instruct2025.0482.6
DocRefine (sent)Base Model=Mistral-Nemo-Instruct2025.0482.34
Sent2Sent (tuned)Base Model=LLaMA-3-8B-Instruct2025.0481.98
DocRefine (doc)Base Model=Mistral-Nemo-Instruct2025.0481.65
Sent2SentBase Model=LLaMA-3-8B-Instruct2025.0481.63
Doc2Doc (tuned)Base Model=LLaMA-3-8B-Instruct2025.0481.25
DocRefine (sent)Base Model=LLaMA-3-8B-Instruct2025.0481.16
Doc2DocBase Model=LLaMA-3-8B-Instruct2025.0481.07