List your company

Machine Translation on Machine Translation Short Q, Short A (test)

0.417BLEUWorldCup
0.155960.223730.29150.35927Feb 2, 2026

Evaluation results

MethodLinks
WorldCupBackbone=GEMMA2-9B-IT, k=12026.020.4170.6680.623
GEMMA2-9B-ITWatermark=None2026.020.407——
BiMarkBackbone=GEMMA2-9B-IT2026.020.3980.6750.606
MPACBackbone=GEMMA2-9B-IT2026.020.3930.6730.686
WorldCupBackbone=GEMMA2-9B-IT, k=22026.020.3610.6730.713
WorldCupBackbone=LLAMA3.1-8B-IT, k=12026.020.3150.6720.768
WorldCupBackbone=LLAMA3.1-8B-IT, k=22026.020.2720.7050.85
LLAMA3.1-8B-ITWatermark=None2026.020.268——
BiMarkBackbone=LLAMA3.1-8B-IT2026.020.2580.7180.768
MPACBackbone=LLAMA3.1-8B-IT2026.020.2240.70.805
WorldCupBackbone=MINISTRAL-8B-IT, k=12026.020.2210.6720.793
WorldCupBackbone=MINISTRAL-8B-IT, k=22026.020.2020.7520.919
MINISTRAL-8B-ITWatermark=None2026.020.2——
BiMarkBackbone=MINISTRAL-8B-IT2026.020.1930.7760.803
MPACBackbone=MINISTRAL-8B-IT2026.020.1660.7450.886