Machine Translation on FLORES-200 ben_Beng (devtest)
48.9Tie (%)GRPO
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GRPOModel Scale=600M, Experiment=A, Sample Size=50 source sentences, Evaluation Protocol=Human preference (one-sided binomial test)2026.05 | 48.9 | 1.98 | 20 | — | 0.895 | |
| Baseline NLLB-200Model Scale=600M, Decoding=beam search, Fine-tuning=none, Sample Size=50 source sentences, Evaluation Protocol=Human preference (one-sided binomial test)2026.05 | 48.9 | — | — | 31.1 | 0.895 |