List your company

Direct Translation on WMT all 54 LPs 24++

0.623SLIQwen3-8B
0.5802560.5913530.602450.613547May 25, 2026

Evaluation results

MethodLinks
Qwen3-8BThinking Mode=Disabled2026.050.623
NLLB-600MDecoding Strategy=Beam Search2026.050.6193
Qwen3-8BThinking Mode=Enabled2026.050.6173
NLLB-3.3BDecoding Strategy=Beam Search2026.050.6145
Qwen3-32BThinking Mode=Disabled2026.050.6142
Gemma4-E4BThinking Mode=Disabled2026.050.613
Qwen3-32BThinking Mode=Enabled2026.050.6107
OLMo-32B-SFTThinking Mode=Enabled, SFT=True2026.050.6098
OLMo-32BThinking Mode=Enabled2026.050.6029
Gemma4-E4BThinking Mode=Enabled2026.050.6026
Gemma4-31BThinking Mode=Disabled2026.050.5945
Gemma4-31BThinking Mode=Enabled2026.050.5939
NLLB-600MDecoding Strategy=Ancestral Sampling2026.050.5897
NLLB-3.3BDecoding Strategy=Ancestral Sampling2026.050.5825
Human2026.050.5819