Machine Translation on WMT FI-EN 19
0.863COMETBeam
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BeamModel=Gemma-3-12B, Decoding Strategy=Beam2026.01 | 0.863 | 0.115 | |
| ℓMAPModel=Gemma-3-12B, Decoding Strategy=ℓMAP2026.01 | 0.863 | 0.114 | |
| ℓSampleModel=Gemma-3-12B, Decoding Strategy=ℓSample2026.01 | 0.863 | 0.114 | |
| Bayes (ours)Model=Gemma-3-12B, Decoding Strategy=Bayes (ours)2026.01 | 0.863 | 0.109 | |
| BeamModel=Qwen3-30B-A3B, Decoding Strategy=Beam2026.01 | 0.863 | 0.113 | |
| Self-ConsistencyModel=Qwen3-30B-A3B, Decoding Strategy=Self-Consistency2026.01 | 0.863 | 0.114 | |
| ℓMAPModel=Qwen3-30B-A3B, Decoding Strategy=ℓMAP2026.01 | 0.863 | 0.114 | |
| ℓSampleModel=Qwen3-30B-A3B, Decoding Strategy=ℓSample2026.01 | 0.863 | 0.113 | |
| Bayes (ours)Model=Qwen3-30B-A3B, Decoding Strategy=Bayes (ours)2026.01 | 0.863 | 0.109 | |
| Self-ConsistencyModel=Gemma-3-12B, Decoding Strategy=Self-Consistency2026.01 | 0.862 | 0.115 | |
| BeamModel=Gemma-3-4B, Decoding Strategy=Beam2026.01 | 0.848 | 0.131 | |
| ℓMAPModel=Gemma-3-4B, Decoding Strategy=ℓMAP2026.01 | 0.848 | 0.131 | |
| ℓSampleModel=Gemma-3-4B, Decoding Strategy=ℓSample2026.01 | 0.848 | 0.13 | |
| Bayes (ours)Model=Gemma-3-4B, Decoding Strategy=Bayes (ours)2026.01 | 0.848 | 0.124 | |
| Self-ConsistencyModel=Gemma-3-4B, Decoding Strategy=Self-Consistency2026.01 | 0.846 | 0.132 | |
| BeamModel=Qwen3-4B, Decoding Strategy=Beam2026.01 | 0.843 | 0.136 | |
| ℓSampleModel=Qwen3-4B, Decoding Strategy=ℓSample2026.01 | 0.843 | 0.136 | |
| Bayes (ours)Model=Qwen3-4B, Decoding Strategy=Bayes (ours)2026.01 | 0.843 | 0.129 | |
| Self-ConsistencyModel=Qwen3-4B, Decoding Strategy=Self-Consistency2026.01 | 0.842 | 0.137 | |
| ℓMAPModel=Qwen3-4B, Decoding Strategy=ℓMAP2026.01 | 0.842 | 0.137 |