Machine Translation on WMT document-level En→Ja 24 (test)

4.373M-Prometheus Scorepfnet/plamo-2-translate

Evaluation results

Method
pfnet/plamo-2-translate2026.06	4.373	4.393
tokyotech-llm/Llama-3.1-Swallow-8B-Instruct-v0.52026.06	4.249	3.049
shisa-ai/shisa-v2.1-llama3.2-3b2026.06	4.154	3.486
tencent/HY-MT1.5-7B2026.06	3.953	3.673
shisa-ai/shisa-v2.1-lfm2-1.2b2026.06	3.84	3.103
google/translategemma-12b-it2026.06	3.728	3.285
CAT-Translate-1.4B2026.06	3.396	3.191
Qwen/Qwen2.5-14B-Instruct2026.06	3.343	3.106
google/translategemma-4b-it2026.06	3.107	2.872
nvidia/NVIDIA-Nemotron-Nano-9B-v2-Japanese2026.06	3.089	3.248
Unbabel/Tower-Plus-9B2026.06	3.053	3.311
CAT-Translate-7B2026.06	2.929	3.143
tencent/HY-MT1.5-1.8B2026.06	2.911	2.847
microsoft/phi-42026.06	2.858	3.187
mistralai/Ministral-8B-Instruct-24102026.06	2.852	2.676
CAT-Translate-3.3B2026.06	2.828	3.057
CAT-Translate-0.8B2026.06	2.817	2.745
sbintuitions/sarashina2.2-3b-instruct-v0.12026.06	2.734	2.715
SakanaAI/TinySwallow-1.5B-Instruct2026.06	2.556	2.49
LiquidAI/LFM2.5-1.2B-JP2026.06	2.538	2.399
google/gemma-2-2b-jpn-it2026.06	2.343	2.37
LiquidAI/LFM2-350M-ENJP-MT2026.06	2.036	2.362
llm-jp/llm-jp-3.1-1.8b-instruct42026.06	1.982	2.291
Rakuten/RakutenAI-2.0-mini-instruct2026.06	1.822	1.804
meta-llama/Llama-3.2-3B-Instruct2026.06	1.485	1.667