Machine Translation on IWSLT 2017 (test)
77.21De-It Translation ScoreSemLing-MNMT
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| SemLing-MNMT2024.08 | 77.21 | — | 79.45 | 78.19 | 78.6 | 81.33 | 80.11 | 79.15 | 83.83 | |
| mRASP2 w/o AA2024.08 | 77.01 | — | 79.27 | 78.14 | 78.49 | 81.24 | 80.16 | 79.05 | 83.8 | |
| m-Transformer2024.08 | 70.14 | — | 74.01 | 71.54 | 71.73 | 74.07 | 73.59 | 72.51 | 83.82 | |
| SemLing-MNMT2024.08 | 48.83 | — | 51.12 | 47.97 | 49.63 | 49.9 | 49.11 | 49.43 | 58.46 | |
| mRASP2 w/o AA2024.08 | 48.36 | — | 50.93 | 47.59 | 49.42 | 49.54 | 48.86 | 49.11 | 58.47 | |
| m-Transformer2024.08 | 43.09 | — | 46.5 | 42.65 | 43.63 | 43.72 | 43.53 | 43.85 | 58.39 | |
| ChatGPT2024.08 | 23.85 | — | 27.01 | 23.21 | 25.17 | 24.72 | 24.83 | 24.79 | 35.26 | |
| Pivot2024.08 | 21.8 | — | 24.14 | 21.23 | 22.63 | 22.19 | 22.27 | 22.37 | — | |
| SemLing-MNMT2024.08 | 21.55 | — | 25.18 | 21.5 | 22.84 | 22.66 | 22.46 | 22.7 | 34.25 | |
| mRASP2 w/o AA2024.08 | 21.39 | — | 24.67 | 21.4 | 22.43 | 22.7 | 21.87 | 22.41 | 34.06 | |
| CrossConST2024.08 | 20.93 | — | 24.1 | 20.65 | 21.98 | 21.68 | 21.4 | 21.73 | 34.1 | |
| TLP2024.08 | 19.52 | — | 23.41 | 19.08 | 20.75 | 20.34 | 20.29 | 20.56 | 34.29 | |
| DT2024.08 | 18.76 | — | 22.05 | 18.65 | 20.04 | 20.31 | 19.83 | 19.94 | 34.17 | |
| m-Transformer2024.08 | 16.94 | — | 20.89 | 17.02 | 17.58 | 17.32 | 17.83 | 17.93 | 34.32 | |
| AlpacaModel size=7B2024.08 | 14.5 | — | 17.94 | 12.88 | 14.46 | 13.44 | 12.18 | 14.23 | 27.37 |