Machine Translation on Machine Translation Short Q, Short A (test)
0.417BLEUWorldCup
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| WorldCupBackbone=GEMMA2-9B-IT, k=12026.02 | 0.417 | 0.668 | 0.623 | |
| GEMMA2-9B-ITWatermark=None2026.02 | 0.407 | — | — | |
| BiMarkBackbone=GEMMA2-9B-IT2026.02 | 0.398 | 0.675 | 0.606 | |
| MPACBackbone=GEMMA2-9B-IT2026.02 | 0.393 | 0.673 | 0.686 | |
| WorldCupBackbone=GEMMA2-9B-IT, k=22026.02 | 0.361 | 0.673 | 0.713 | |
| WorldCupBackbone=LLAMA3.1-8B-IT, k=12026.02 | 0.315 | 0.672 | 0.768 | |
| WorldCupBackbone=LLAMA3.1-8B-IT, k=22026.02 | 0.272 | 0.705 | 0.85 | |
| LLAMA3.1-8B-ITWatermark=None2026.02 | 0.268 | — | — | |
| BiMarkBackbone=LLAMA3.1-8B-IT2026.02 | 0.258 | 0.718 | 0.768 | |
| MPACBackbone=LLAMA3.1-8B-IT2026.02 | 0.224 | 0.7 | 0.805 | |
| WorldCupBackbone=MINISTRAL-8B-IT, k=12026.02 | 0.221 | 0.672 | 0.793 | |
| WorldCupBackbone=MINISTRAL-8B-IT, k=22026.02 | 0.202 | 0.752 | 0.919 | |
| MINISTRAL-8B-ITWatermark=None2026.02 | 0.2 | — | — | |
| BiMarkBackbone=MINISTRAL-8B-IT2026.02 | 0.193 | 0.776 | 0.803 | |
| MPACBackbone=MINISTRAL-8B-IT2026.02 | 0.166 | 0.745 | 0.886 |