Machine Translation on WMT ZH-EN 22
82.7COMETGoogleMT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| GoogleMT2023.11 | 82.7 | 79.3 | — | — | |
| OracleSelection=Upper bound2024.02 | 81.2 | — | — | — | |
| WMT-Best2023.11 | 81 | 77.7 | — | — | |
| TIM-13Bbackbone=tigerbot-13b-base2023.11 | 80.8 | 77.8 | — | — | |
| MicroMT2023.11 | 80.3 | 77.5 | — | — | |
| TIM-7B2024.05 | 79.33 | — | 23.81 | — | |
| G-DIGDiversity=false2024.05 | 78.43 | — | 20.35 | 65.08 | |
| G-DIGDiversity=true2024.05 | 78.29 | — | 20.63 | 64.86 | |
| Reward2024.05 | 77.9 | — | 16.29 | 64.64 | |
| Bayling-13B2024.05 | 77.72 | — | 20.12 | — | |
| BayLing-7Bbackbone=7B2023.11 | 77.5 | 75.1 | — | — | |
| MBRCandidates=10242024.02 | 77.3 | — | — | — | |
| PruneMBRPruning=Confidence-based2024.02 | 77.3 | — | — | — | |
| CBMBRInitialization=random, Centroids (k)=642024.02 | 77.2 | — | — | — | |
| CBMBRInitialization=kmeans++, Centroids (k)=642024.02 | 77.1 | — | — | — | |
| QEModel=COMETKIWI2024.02 | 76.9 | — | — | — | |
| Random2024.05 | 75.55 | — | 14.31 | 61.35 | |
| BigTranslate-13B2024.05 | 74.26 | — | 14.16 | — | |
| NLLB-54B2024.05 | 70.7 | — | 16.56 | — | |
| MAPDecoding=Beam Search, Beam Size=2562024.02 | 70.1 | — | — | — | |
| C-DPOSize=70B, Evaluation Protocol=5-shot2024.09 | 33.01 | — | — | — | |
| C-SFTSize=70B, Evaluation Protocol=5-shot2024.09 | 32.41 | — | — | — | |
| Llama-3 InstructSize=70B, Evaluation Protocol=5-shot2024.09 | 28.03 | — | — | — | |
| C-SFTSize=8B, Evaluation Protocol=5-shot2024.09 | 26.49 | — | — | — | |
| C-DPOSize=8B, Evaluation Protocol=5-shot2024.09 | 25.74 | — | — | — | |
| Llama-3 InstructSize=8B, Evaluation Protocol=5-shot2024.09 | 21.83 | — | — | — |