List your company
ResearchFormerly WizWand

Machine Translation on Es-En document-level translation

88.99d-COMETOurs
86.525287.165187.80588.4449Apr 8, 2025
Updated 8mo ago

Evaluation results

MethodLinks
OursBase Model=Mistral-Nemo-Instruct, Quality-aware fine-tuning=true2025.0488.99
DocRefine (sent)Base Model=Mistral-Nemo-Instruct2025.0488.5
OursBase Model=LLaMA-3-8B-Instruct, Quality-aware fine-tuning=true2025.0488.42
DocRefine (doc)Base Model=Mistral-Nemo-Instruct2025.0488.37
Ours (-QA)Base Model=LLaMA-3-8B-Instruct, Quality-aware fine-tuning=false2025.0488.35
Doc2Doc (tuned)Base Model=Mistral-Nemo-Instruct2025.0488.34
Ours (-QA)Base Model=Mistral-Nemo-Instruct, Quality-aware fine-tuning=false2025.0488.27
SentRefine (sent)Base Model=Mistral-Nemo-Instruct2025.0488.23
DocRefine (doc)Base Model=LLaMA-3-8B-Instruct2025.0488.06
Doc2Doc (tuned)Base Model=LLaMA-3-8B-Instruct2025.0488.04
SentRefine (sent)Base Model=LLaMA-3-8B-Instruct2025.0487.99
DocRefine (sent)Base Model=LLaMA-3-8B-Instruct2025.0487.98
Doc2DocBase Model=Mistral-Nemo-Instruct2025.0487.64
Sent2Sent (tuned)Base Model=LLaMA-3-8B-Instruct2025.0487.46
Doc2DocBase Model=LLaMA-3-8B-Instruct2025.0487.21
Sent2SentBase Model=Mistral-Nemo-Instruct2025.0487.21
Sent2Sent (tuned)Base Model=Mistral-Nemo-Instruct2025.0486.89
Sent2SentBase Model=LLaMA-3-8B-Instruct2025.0486.62