Machine Translation (en->it) on Tatoeba
63.2611sacreBLEUPhiMaestra-3
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| PhiMaestra-32026.01 | 63.2611 | 78.9462 | 0.6316 | 0.9948 | 0.9361 | 1.2135 | 0.7894 | |
| Madlad-7BBeam Search=52026.01 | 59.2901 | 76.1905 | 0.5868 | 0.8627 | 0.9309 | 1.0488 | 0.7976 | |
| Madlad-3BBeam Search=52026.01 | 59.1354 | 76.0725 | 0.5861 | 0.8628 | 0.9309 | 1.0412 | 0.7992 | |
| Madlad-7B2026.01 | 58.7694 | 75.7748 | 0.584 | 0.8835 | 0.9301 | 1.0762 | 0.7945 | |
| Madlad-3B2026.01 | 58.7088 | 75.6615 | 0.5835 | 0.8898 | 0.9301 | 1.074 | 0.7952 | |
| DIETA+nosynth2026.01 | 58.5519 | 75.5547 | 0.5699 | 0.963 | 0.9255 | 1.1364 | 0.7895 | |
| DIETA+cont2026.01 | 58.2852 | 75.2529 | 0.5781 | 0.9238 | 0.9271 | 1.0958 | 0.7917 | |
| DIETA2026.01 | 58.1757 | 75.2797 | 0.5647 | 0.9967 | 0.9241 | 1.1521 | 0.7883 | |
| Gemma-9BBeam Search=52026.01 | 58.1195 | 74.9054 | 0.5694 | 0.8534 | 0.9289 | 1.0032 | 0.8013 | |
| DIETA+allsynth2026.01 | 58.1076 | 75.1633 | 0.576 | 0.9251 | 0.9268 | 1.0907 | 0.7905 | |
| NLLB-3.3B2026.01 | 57.8852 | 75.022 | 0.5769 | 0.9348 | 0.9272 | 1.1115 | 0.7938 | |
| opus-mt-bigBeam Search=52026.01 | 57.3737 | 74.7236 | 0.5679 | 0.971 | 0.924 | 1.1316 | 0.7881 | |
| opus-mt-big2026.01 | 57.3413 | 74.6934 | 0.5681 | 0.9708 | 0.9241 | 1.1288 | 0.7882 | |
| NLLB-1.3BBeam Search=52026.01 | 57.0355 | 74.6561 | 0.5719 | 0.9162 | 0.9256 | 1.0968 | 0.7942 | |
| Gemma-9B2026.01 | 56.8466 | 74.0559 | 0.5607 | 0.8921 | 0.9276 | 1.0376 | 0.798 | |
| NLLB-1.3B2026.01 | 56.1866 | 73.8551 | 0.562 | 0.9611 | 0.9236 | 1.1402 | 0.7904 | |
| Gemma-2BBeam Search=52026.01 | 55.7561 | 73.3125 | 0.5488 | 0.9003 | 0.926 | 1.0185 | 0.8001 | |
| DIETA+BT2026.01 | 55.3152 | 73.2365 | 0.5504 | 1.0751 | 0.9191 | 1.19 | 0.7837 | |
| NLLB-600MBeam Search=52026.01 | 54.9625 | 73.1885 | 0.5526 | 0.9889 | 0.9224 | 1.1422 | 0.7922 | |
| opus-mt2026.01 | 54.2471 | 73.3821 | 0.5524 | 0.999 | 0.9185 | 1.1681 | 0.7826 | |
| Gemma-2B2026.01 | 54.0203 | 72.1165 | 0.5338 | 0.9685 | 0.9223 | 1.077 | 0.7938 | |
| NLLB-600M2026.01 | 53.734 | 72.0342 | 0.5372 | 1.0852 | 0.9188 | 1.23 | 0.7857 | |
| Tower-7B2026.01 | 52.5356 | 71.7015 | 0.5196 | 0.9639 | 0.9211 | 1.0561 | 0.7965 | |
| Llama-3.1-8B2026.01 | 50.7976 | 69.9445 | 0.5048 | 1.1118 | 0.9149 | 1.2065 | 0.7824 | |
| ModelloItalia-9B2026.01 | 50.2067 | 68.8684 | 0.4464 | 1.3001 | 0.9027 | 1.4173 | 0.7628 | |
| mBART2026.01 | 49.0347 | 68.9805 | 0.4873 | 1.2963 | 0.9093 | 1.2699 | 0.7855 | |
| mBARTBeam Search=52026.01 | 49.0347 | 68.9805 | 0.4873 | 1.2963 | 0.9093 | 1.2699 | 0.7855 | |
| Minerva-7B2026.01 | 48.035 | 67.9585 | 0.4209 | 1.4798 | 0.9076 | 1.5119 | 0.757 | |
| Cerbero-7B2026.01 | 46.7861 | 67.6616 | 0.4507 | 1.3372 | 0.9022 | 1.3325 | 0.7772 | |
| Maestrale-v0.42026.01 | 43.1752 | 66.8957 | 0.4508 | 1.2718 | 0.9027 | 1.3073 | 0.7774 | |
| EuroLLM-9B2026.01 | 42.8195 | 64.7264 | 0.4304 | 1.2764 | 0.8992 | 1.2767 | 0.7741 | |
| LLaMAntino-8B2026.01 | 35.8557 | 61.3278 | 0.3745 | 1.8919 | 0.8738 | 1.8448 | 0.7397 | |
| EuroLLM-1.7B2026.01 | 31.8519 | 56.9232 | 0.3186 | 2.115 | 0.8583 | 1.8843 | 0.718 |