Direct Translation on WMT all 54 LPs 24++
0.623SLIQwen3-8B
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen3-8BThinking Mode=Disabled2026.05 | 0.623 | |
| NLLB-600MDecoding Strategy=Beam Search2026.05 | 0.6193 | |
| Qwen3-8BThinking Mode=Enabled2026.05 | 0.6173 | |
| NLLB-3.3BDecoding Strategy=Beam Search2026.05 | 0.6145 | |
| Qwen3-32BThinking Mode=Disabled2026.05 | 0.6142 | |
| Gemma4-E4BThinking Mode=Disabled2026.05 | 0.613 | |
| Qwen3-32BThinking Mode=Enabled2026.05 | 0.6107 | |
| OLMo-32B-SFTThinking Mode=Enabled, SFT=True2026.05 | 0.6098 | |
| OLMo-32BThinking Mode=Enabled2026.05 | 0.6029 | |
| Gemma4-E4BThinking Mode=Enabled2026.05 | 0.6026 | |
| Gemma4-31BThinking Mode=Disabled2026.05 | 0.5945 | |
| Gemma4-31BThinking Mode=Enabled2026.05 | 0.5939 | |
| NLLB-600MDecoding Strategy=Ancestral Sampling2026.05 | 0.5897 | |
| NLLB-3.3BDecoding Strategy=Ancestral Sampling2026.05 | 0.5825 | |
| Human2026.05 | 0.5819 |