Machine Translation on general 2023 (test)
32.64BLEUMAP
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MAPBackbone=TowerInstruct-13B, Sampling strategy=epsilon sampling, Candidate size (|C|)=1282024.06 | 32.64 | 86.43 | 3.22 | |
| MBRBackbone=TowerInstruct-13B, Sampling strategy=epsilon sampling, Candidate size (|C|)=128, Source number (|S|)=172024.06 | 31.93 | 88.83 | 2.6 | |
| MAPBackbone=TowerInstruct-13B, Sampling strategy=epsilon sampling, Candidate size (|C|)=52024.06 | 30.24 | 86.06 | 3.32 | |
| MBRBackbone=TowerInstruct-13B, Sampling strategy=epsilon sampling, Candidate size (|C|)=128, Source number (|S|)=1282024.06 | 29.84 | 89.19 | 2.46 | |
| QE rerankingBackbone=TowerInstruct-13B, Sampling strategy=epsilon sampling, Candidate size (|C|)=128, Source number (|S|)=12024.06 | 29.4 | 88.76 | 2.56 | |
| sMBR-BTBackbone=TowerInstruct-13B, Sampling strategy=epsilon sampling, Candidate size (|C|)=128, Source number (|S|)=172024.06 | 28.73 | 89.04 | 2.5 | |
| MBRBackbone=TowerInstruct-13B, Sampling strategy=epsilon sampling, Candidate size (|C|)=5, Source number (|S|)=52024.06 | 28.1 | 87.3 | 2.95 | |
| sMBR-PPBackbone=TowerInstruct-13B, Sampling strategy=epsilon sampling, Candidate size (|C|)=128, Source number (|S|)=172024.06 | 27.19 | 89.47 | 2.44 | |
| MBRBackbone=TowerInstruct-13B, Sampling strategy=epsilon sampling, Candidate size (|C|)=128, Source number (|S|)=172024.06 | 23.34 | 90.43 | 1.87 | |
| MAPBackbone=TowerInstruct-13B, Sampling strategy=epsilon sampling, Candidate size (|C|)=1282024.06 | 23.12 | 89.14 | 2.2 | |
| MBRBackbone=TowerInstruct-13B, Sampling strategy=epsilon sampling, Candidate size (|C|)=128, Source number (|S|)=1282024.06 | 22.01 | 90.39 | 1.9 | |
| MAPBackbone=TowerInstruct-13B, Sampling strategy=epsilon sampling, Candidate size (|C|)=52024.06 | 20.73 | 88.15 | 2.41 | |
| QE rerankingBackbone=TowerInstruct-13B, Sampling strategy=epsilon sampling, Candidate size (|C|)=128, Source number (|S|)=12024.06 | 19.88 | 90.64 | 1.89 | |
| sMBR-PPBackbone=TowerInstruct-13B, Sampling strategy=epsilon sampling, Candidate size (|C|)=128, Source number (|S|)=172024.06 | 19.87 | 90.7 | 1.87 | |
| sMBR-BTBackbone=TowerInstruct-13B, Sampling strategy=epsilon sampling, Candidate size (|C|)=128, Source number (|S|)=172024.06 | 19.77 | 90.38 | 1.98 | |
| MBRBackbone=TowerInstruct-13B, Sampling strategy=epsilon sampling, Candidate size (|C|)=5, Source number (|S|)=52024.06 | 19.74 | 88.96 | 2.2 |