Machine Translation on NTREX-128
5.22Delta chrF++GRPO for Seq2Seq MT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GRPO for Seq2Seq MTModel Size=1.3B, Language=zho_Hant, Language Group=Isol.2026.05 | 5.22 | — | |
| GRPO for Seq2Seq MTModel Size=600M, Language=zho_Hant, Language Group=Isol.2026.05 | 3.74 | — | |
| GRPO for Seq2Seq MTModel Size=600M, Language=bod, Language Group=Aggl.2026.05 | 3.39 | — | |
| NLLB-200 (SFT3ep)Model Size=600M, Language=yor, Language Group=Isol.2026.05 | 2.13 | — | |
| GRPO for Seq2Seq MTModel Size=1.3B, Language=jpn, Language Group=Aggl.2026.05 | 2.12 | — | |
| GRPO for Seq2Seq MTModel Size=600M, Language=jpn, Language Group=Aggl.2026.05 | 2.08 | — | |
| GRPO for Seq2Seq MTModel Size=1.3B, Language=eus, Language Group=Aggl.2026.05 | 2.07 | — | |
| NLLB-200 (SFT3ep)Model Size=600M, Language=zho_Hant, Language Group=Isol.2026.05 | 2.03 | — | |
| GRPO for Seq2Seq MTModel Size=600M, Language=eus, Language Group=Aggl.2026.05 | 1.91 | — | |
| NLLB-200 (SFT3ep)Model Size=600M, Language=eus, Language Group=Aggl.2026.05 | 1.75 | — | |
| NLLB-200 (SFT3ep)Model Size=600M, Language=arb, Language Group=Root-pat.2026.05 | 1.6 | — | |
| NLLB-200 (SFT3ep)Model Size=600M, Language=ben, Language Group=Fus.2026.05 | 1.53 | — | |
| NLLB-200 (SFT3ep)Model Size=600M, Language=bod, Language Group=Aggl.2026.05 | 1.47 | — | |
| GRPO for Seq2Seq MTModel Size=600M, Language=ben, Language Group=Fus.2026.05 | 1.45 | — | |
| GRPO for Seq2Seq MTModel Size=1.3B, Language=arb, Language Group=Root-pat.2026.05 | 1.1 | — | |
| NLLB-200 (SFT3ep)Model Size=600M, Language=jpn, Language Group=Aggl.2026.05 | 1.03 | — | |
| GRPO for Seq2Seq MTModel Size=1.3B, Language=swh, Language Group=Aggl.2026.05 | 1.01 | — | |
| GRPO for Seq2Seq MTModel Size=1.3B, Language=bod, Language Group=Aggl.2026.05 | 0.98 | — | |
| GRPO for Seq2Seq MTModel Size=1.3B, Language=ben, Language Group=Fus.2026.05 | 0.97 | — | |
| NLLB-200 (SFT3ep)Model Size=600M, Language=tur, Language Group=Aggl.2026.05 | 0.8 | — | |
| GRPO for Seq2Seq MTModel Size=1.3B, Language=yor, Language Group=Isol.2026.05 | 0.79 | — | |
| GRPO for Seq2Seq MTModel Size=1.3B, Language=zho_Hans, Language Group=Isol.2026.05 | 0.78 | — | |
| GRPO for Seq2Seq MTModel Size=600M, Language=yor, Language Group=Isol.2026.05 | 0.78 | — | |
| GRPO for Seq2Seq MTModel Size=600M, Language=tur, Language Group=Aggl.2026.05 | 0.72 | — | |
| NLLB-200 (SFT3ep)Model Size=600M, Language=zho_Hans, Language Group=Isol.2026.05 | 0.7 | — | |
| GRPO for Seq2Seq MTModel Size=600M, Language=bel, Language Group=Fus.2026.05 | 0.63 | — | |
| NLLB-200 (SFT3ep)Model Size=600M, Language=swh, Language Group=Aggl.2026.05 | 0.61 | — | |
| NLLB-200 (SFT3ep)Model Size=600M, Language=bel, Language Group=Fus.2026.05 | 0.54 | — | |
| NLLB-200 (SFT3ep)Model Size=600M, Language=pol, Language Group=Fus.2026.05 | 0.43 | — | |
| GRPO for Seq2Seq MTModel Size=1.3B, Language=tur, Language Group=Aggl.2026.05 | 0.39 | — | |
| GRPO for Seq2Seq MTModel Size=600M, Language=arb, Language Group=Root-pat.2026.05 | 0.38 | — | |
| GRPO for Seq2Seq MTModel Size=600M, Language=zho_Hans, Language Group=Isol.2026.05 | 0.34 | — | |
| GRPO for Seq2Seq MTModel Size=1.3B, Language=pol, Language Group=Fus.2026.05 | 0.23 | — | |
| GRPO for Seq2Seq MTModel Size=1.3B, Language=bel, Language Group=Fus.2026.05 | 0.21 | — | |
| GRPO for Seq2Seq MTModel Size=1.3B, Language=ces, Language Group=Fus.2026.05 | 0.2 | — | |
| NLLB-200 (SFT3ep)Model Size=600M, Language=ces, Language Group=Fus.2026.05 | 0.1 | — | |
| GRPO for Seq2Seq MTModel Size=600M, Language=swh, Language Group=Aggl.2026.05 | 0.09 | — | |
| GRPO for Seq2Seq MTModel Size=600M, Language=pol, Language Group=Fus.2026.05 | 0.01 | — | |
| GRPO for Seq2Seq MTModel Size=600M, Language=ces, Language Group=Fus.2026.05 | 0 | — | |
| NLLB-200 (Base)Model Size=600M, Language=eus, Language Group=Aggl.2026.05 | — | 45.32 | |
| NLLB-200 (Base)Model Size=1.3B, Language=eus, Language Group=Aggl.2026.05 | — | 46.4 | |
| NLLB-200 (Base)Model Size=600M, Language=swh, Language Group=Aggl.2026.05 | — | 60.51 | |
| NLLB-200 (Base)Model Size=1.3B, Language=swh, Language Group=Aggl.2026.05 | — | 61.21 | |
| NLLB-200 (Base)Model Size=600M, Language=bod, Language Group=Aggl.2026.05 | — | 24.6 | |
| NLLB-200 (Base)Model Size=1.3B, Language=bod, Language Group=Aggl.2026.05 | — | 26.81 | |
| NLLB-200 (Base)Model Size=600M, Language=tur, Language Group=Aggl.2026.05 | — | 46.72 | |
| NLLB-200 (Base)Model Size=1.3B, Language=tur, Language Group=Aggl.2026.05 | — | 49.26 | |
| NLLB-200 (Base)Model Size=600M, Language=jpn, Language Group=Aggl.2026.05 | — | 21.08 | |
| NLLB-200 (Base)Model Size=1.3B, Language=jpn, Language Group=Aggl.2026.05 | — | 22.66 | |
| NLLB-200 (Base)Model Size=600M, Language=zho_Hant, Language Group=Isol.2026.05 | — | 7.6 | |
| NLLB-200 (Base)Model Size=1.3B, Language=zho_Hant, Language Group=Isol.2026.05 | — | 7.75 | |
| NLLB-200 (Base)Model Size=600M, Language=zho_Hans, Language Group=Isol.2026.05 | — | 8.95 | |
| NLLB-200 (Base)Model Size=1.3B, Language=zho_Hans, Language Group=Isol.2026.05 | — | 8.95 | |
| NLLB-200 (Base)Model Size=600M, Language=yor, Language Group=Isol.2026.05 | — | 16.55 | |
| NLLB-200 (Base)Model Size=1.3B, Language=yor, Language Group=Isol.2026.05 | — | 18.11 | |
| NLLB-200 (Base)Model Size=600M, Language=arb, Language Group=Root-pat.2026.05 | — | 47.07 | |
| NLLB-200 (Base)Model Size=1.3B, Language=arb, Language Group=Root-pat.2026.05 | — | 49.27 | |
| NLLB-200 (Base)Model Size=600M, Language=bel, Language Group=Fus.2026.05 | — | 50.36 | |
| NLLB-200 (Base)Model Size=1.3B, Language=bel, Language Group=Fus.2026.05 | — | 53.2 | |
| NLLB-200 (Base)Model Size=600M, Language=ben, Language Group=Fus.2026.05 | — | 46.21 | |
| NLLB-200 (Base)Model Size=1.3B, Language=ben, Language Group=Fus.2026.05 | — | 48.22 | |
| NLLB-200 (Base)Model Size=600M, Language=ces, Language Group=Fus.2026.05 | — | 52.1 | |
| NLLB-200 (Base)Model Size=1.3B, Language=ces, Language Group=Fus.2026.05 | — | 54.77 | |
| NLLB-200 (Base)Model Size=600M, Language=pol, Language Group=Fus.2026.05 | — | 48.09 | |
| NLLB-200 (Base)Model Size=1.3B, Language=pol, Language Group=Fus.2026.05 | — | 50.2 |