List your company
ResearchFormerly WizWand

Machine Translation on En-Zh document-level translation

84.53d-COMETOurs
76.490878.577980.66582.7521Apr 8, 2025
Updated 8mo ago

Evaluation results

MethodLinks
OursBase Model=Mistral-Nemo-Instruct, Quality-aware fine-tuning=true2025.0484.53
DocRefine (sent)Base Model=Mistral-Nemo-Instruct2025.0484.06
DocRefine (doc)Base Model=Mistral-Nemo-Instruct2025.0483.86
Ours (-QA)Base Model=Mistral-Nemo-Instruct, Quality-aware fine-tuning=false2025.0483.86
OursBase Model=LLaMA-3-8B-Instruct, Quality-aware fine-tuning=true2025.0483.35
Ours (-QA)Base Model=LLaMA-3-8B-Instruct, Quality-aware fine-tuning=false2025.0482.98
SentRefine (sent)Base Model=LLaMA-3-8B-Instruct2025.0482.93
Sent2Sent (tuned)Base Model=LLaMA-3-8B-Instruct2025.0482.84
DocRefine (doc)Base Model=LLaMA-3-8B-Instruct2025.0482.7
DocRefine (sent)Base Model=LLaMA-3-8B-Instruct2025.0482.61
Doc2Doc (tuned)Base Model=LLaMA-3-8B-Instruct2025.0482.18
Doc2DocBase Model=LLaMA-3-8B-Instruct2025.0481.89
Doc2DocBase Model=Mistral-Nemo-Instruct2025.0481.34
Doc2Doc (tuned)Base Model=Mistral-Nemo-Instruct2025.0481.27
SentRefine (sent)Base Model=Mistral-Nemo-Instruct2025.0481.27
Sent2Sent (tuned)Base Model=Mistral-Nemo-Instruct2025.0481.18
Sent2SentBase Model=Mistral-Nemo-Instruct2025.0479.39
Sent2SentBase Model=LLaMA-3-8B-Instruct2025.0476.8