List your company

Machine Translation on 10-language machine translation evaluation suite (test)

89.94De->En ScoreOurs
87.620888.222988.82589.4271Apr 8, 2025

Evaluation results

MethodLinks
OursBackbone=Mistral-Nemo-Instruct2025.0489.9490.4586.188.5187.9688.5389.0288.3187.1688.0488.4
Ours - QA Fine-tuningBackbone=Mistral-Nemo-Instruct2025.0489.990.1285.8288.6587.8788.4988.8787.8187.0787.7188.23
DocRefine docBackbone=Mistral-Nemo-Instruct2025.0489.7490.0683.588.2187.4988.2188.6986.3386.8587.4487.65
Doc2Doc tunedBackbone=Mistral-Nemo-Instruct2025.0489.790.285.0188.6187.785.9188.6685.1986.9987.5687.53
OursBackbone=LLaMA-3-8B-Instruct2025.0489.6389.9584.5888.5887.2687.7688.6186.3486.586.8887.61
DocRefine sentBackbone=Mistral-Nemo-Instruct2025.0489.6390.0384.2188.0287.6488.2488.6886.9386.987.5587.78
Ours - QA Fine-tuningBackbone=LLaMA-3-8B-Instruct2025.0489.4189.8884.4488.4387.1987.4388.3785.6386.1486.6987.36
Doc2Doc tunedBackbone=LLaMA-3-8B-Instruct2025.0489.3589.9180.5188.2986.3887.288.283.7686.2685.5186.54
SentRefine sentBackbone=Mistral-Nemo-Instruct2025.0489.3389.885.5188.2486.7188.0488.387.8986.7786.7187.73
DocRefine docBackbone=LLaMA-3-8B-Instruct2025.0489.2289.5184.4588.2487.2586.8688.3486.1286.3986.787.31
Doc2DocBackbone=Mistral-Nemo-Instruct2025.0489.1589.2985.1687.986.8186.5687.386.6685.6585.7487.02
SentRefine sentBackbone=LLaMA-3-8B-Instruct2025.0489.1289.6585.2988.0886.5387.188.1787.1686.3886.787.42
DocRefine sentBackbone=LLaMA-3-8B-Instruct2025.0488.9689.0883.0988.4587.1987.1888.1783.2186.0886.4286.78
Sent2Sent tunedBackbone=LLaMA-3-8B-Instruct2025.0488.9388.9186.3888.3386.2786.2887.1286.2586.4386.4987.14
Doc2DocBackbone=LLaMA-3-8B-Instruct2025.0488.6288.7684.4787.3685.8483.8787.0782.6184.7983.8585.72
Sent2SentBackbone=Mistral-Nemo-Instruct2025.0488.5288.484.248786.1886.6487.3286.2585.5285.4186.54
Sent2Sent tunedBackbone=Mistral-Nemo-Instruct2025.0488.4988.5585.0387.7886.4287.2487.2287.1786.5285.8587.03
Sent2SentBackbone=LLaMA-3-8B-Instruct2025.0487.7188.3283.7486.6384.684.4786.8283.2384.5579.7684.98