List your company
ResearchFormerly WizWand

Machine Translation on document-level translation En-Fr

85.5d-COMETOurs
81.173682.296883.4284.5432Apr 8, 2025
Updated 8mo ago

Evaluation results

MethodLinks
OursBase Model=Mistral-Nemo-Instruct, Quality-aware fine-tuning=true2025.0485.5
Ours (-QA)Base Model=Mistral-Nemo-Instruct, Quality-aware fine-tuning=false2025.0485.43
Doc2Doc (tuned)Base Model=Mistral-Nemo-Instruct2025.0485.28
DocRefine (doc)Base Model=Mistral-Nemo-Instruct2025.0485.11
DocRefine (sent)Base Model=Mistral-Nemo-Instruct2025.0485.09
SentRefine (sent)Base Model=Mistral-Nemo-Instruct2025.0485.06
OursBase Model=LLaMA-3-8B-Instruct, Quality-aware fine-tuning=true2025.0484.84
DocRefine (doc)Base Model=LLaMA-3-8B-Instruct2025.0484.73
Doc2Doc (tuned)Base Model=LLaMA-3-8B-Instruct2025.0484.63
SentRefine (sent)Base Model=LLaMA-3-8B-Instruct2025.0484.57
Sent2Sent (tuned)Base Model=Mistral-Nemo-Instruct2025.0484.49
Ours (-QA)Base Model=LLaMA-3-8B-Instruct, Quality-aware fine-tuning=false2025.0484.48
DocRefine (sent)Base Model=LLaMA-3-8B-Instruct2025.0484.43
Sent2Sent (tuned)Base Model=LLaMA-3-8B-Instruct2025.0484.3
Sent2SentBase Model=Mistral-Nemo-Instruct2025.0483.67
Doc2DocBase Model=LLaMA-3-8B-Instruct2025.0483.14
Sent2SentBase Model=LLaMA-3-8B-Instruct2025.0482.89
Doc2DocBase Model=Mistral-Nemo-Instruct2025.0481.34