List your company
ResearchFormerly WizWand

Machine Translation on De-En document-level

88.45d-COMETOurs
82.26283.868585.47587.0815Apr 8, 2025
Updated 8mo ago

Evaluation results

MethodLinks
OursBase Model=Mistral-Nemo-Instruct, Quality-aware fine-tuning=true2025.0488.45
OursBase Model=LLaMA-3-8B-Instruct, Quality-aware fine-tuning=true2025.0488.14
DocRefine (doc)Base Model=Mistral-Nemo-Instruct2025.0488.13
DocRefine (sent)Base Model=Mistral-Nemo-Instruct2025.0488.09
Ours (-QA)Base Model=LLaMA-3-8B-Instruct, Quality-aware fine-tuning=false2025.0488.02
Ours (-QA)Base Model=Mistral-Nemo-Instruct, Quality-aware fine-tuning=false2025.0488.01
Sent2Sent (tuned)Base Model=LLaMA-3-8B-Instruct2025.0487.94
Doc2Doc (tuned)Base Model=LLaMA-3-8B-Instruct2025.0487.82
Doc2Doc (tuned)Base Model=Mistral-Nemo-Instruct2025.0487.8
SentRefine (sent)Base Model=Mistral-Nemo-Instruct2025.0487.73
DocRefine (doc)Base Model=LLaMA-3-8B-Instruct2025.0487.71
Doc2DocBase Model=Mistral-Nemo-Instruct2025.0487.61
DocRefine (sent)Base Model=LLaMA-3-8B-Instruct2025.0487.42
Doc2DocBase Model=LLaMA-3-8B-Instruct2025.0487.05
OursBase Model=Mistral-Nemo-Instruct, Quality-aware fine-tuning=true2025.0486.89
Sent2Sent (tuned)Base Model=Mistral-Nemo-Instruct2025.0486.86
Sent2SentBase Model=Mistral-Nemo-Instruct2025.0486.85
Ours (-QA)Base Model=Mistral-Nemo-Instruct, Quality-aware fine-tuning=false2025.0486.7
DocRefine (sent)Base Model=Mistral-Nemo-Instruct2025.0486.58
Doc2Doc (tuned)Base Model=Mistral-Nemo-Instruct2025.0486.5
DocRefine (doc)Base Model=Mistral-Nemo-Instruct2025.0486.44
SentRefine (sent)Base Model=Mistral-Nemo-Instruct2025.0486.36
OursBase Model=LLaMA-3-8B-Instruct, Quality-aware fine-tuning=true2025.0486.05
Sent2SentBase Model=LLaMA-3-8B-Instruct2025.0485.97
Ours (-QA)Base Model=LLaMA-3-8B-Instruct, Quality-aware fine-tuning=false2025.0485.7
Sent2Sent (tuned)Base Model=Mistral-Nemo-Instruct2025.0485.49
Doc2Doc (tuned)Base Model=LLaMA-3-8B-Instruct2025.0485.45
Sent2Sent (tuned)Base Model=LLaMA-3-8B-Instruct2025.0485.42
DocRefine (sent)Base Model=LLaMA-3-8B-Instruct2025.0485.38
SentRefine (sent)Base Model=LLaMA-3-8B-Instruct2025.0485.21
DocRefine (doc)Base Model=LLaMA-3-8B-Instruct2025.0485.07
Sent2SentBase Model=Mistral-Nemo-Instruct2025.0484.66
Doc2DocBase Model=Mistral-Nemo-Instruct2025.0484.34
SentRefine (sent)Base Model=LLaMA-3-8B-Instruct2025.0483.7
Doc2DocBase Model=LLaMA-3-8B-Instruct2025.0483.35
Sent2SentBase Model=LLaMA-3-8B-Instruct2025.0482.5