Machine Translation on OPUS-7 (test)
74.64Translation Score (X -> Ar)SemLing-MNMT
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SemLing-MNMT2024.08 | 74.64 | — | 68.74 | 73.33 | 71.02 | 76.65 | 74.18 | 73.09 | 79.66 | — | — | |
| mRASP2 w/o AA2024.08 | 74.36 | — | 68.41 | 72.77 | 70.89 | 76.15 | 74.02 | 72.77 | 79.25 | — | — | |
| m-Transformer2024.08 | 72.33 | — | 65.77 | 70.67 | 68.97 | 73.48 | 71.52 | 70.46 | 79.45 | — | — | |
| SemLing-MNMT2024.08 | 40.4 | — | 40.67 | 51.34 | 39.55 | 44.53 | 26.95 | 40.57 | 53.86 | — | — | |
| mRASP2 w/o AA2024.08 | 39.76 | — | 40.55 | 50.83 | 39.68 | 43.78 | 26.03 | 40.1 | 53.28 | — | — | |
| m-Transformer2024.08 | 37.69 | — | 37.08 | 48.16 | 37.6 | 41 | 25.22 | 37.79 | 53.77 | — | — | |
| Transformer-subwordParameters=60.5M, Tokenization=Subword, Direction=En -> XX2024.05 | 21.61 | — | 29.66 | 31.84 | 27.97 | 30.7 | 25.72 | — | — | 27.92 | 31.27 | |
| Pivot2024.08 | 15.79 | — | 17.48 | 27.81 | 18.5 | 20.98 | 15.71 | 19.38 | — | — | — | |
| MSCParameters=44.8M, Direction=En -> XX2024.05 | 14.86 | — | 27.89 | 26.62 | 25.39 | 19.57 | 28.43 | — | — | 23.8 | 26.79 | |
| SemLing-MNMT2024.08 | 14.79 | — | 16.64 | 26.2 | 17.42 | 20.11 | 17.4 | 18.76 | 32.13 | — | — | |
| Byte-nCFParameters=47.0M, Direction=En -> XX2024.05 | 14.58 | — | 27.05 | 27.58 | 26.59 | 19.6 | 28.17 | — | — | 23.53 | 26.59 | |
| mRASP2 w/o AA2024.08 | 14.2 | — | 16.54 | 25.67 | 17.46 | 19.29 | 17.72 | 18.48 | 31.48 | — | — | |
| DT2024.08 | 13.84 | — | 15.06 | 23.95 | 16.24 | 18.29 | 17.85 | 17.54 | 31.96 | — | — | |
| CrossConST2024.08 | 13.68 | — | 15.04 | 23.67 | 16.5 | 17.67 | 16.03 | 17.1 | 32.12 | — | — | |
| Transformer-byteParameters=44.6M, Tokenization=Byte, Direction=En -> XX2024.05 | 13.51 | — | 26.45 | 25.09 | 24 | 18.28 | 26.59 | — | — | 22.32 | 25.19 | |
| TLP2024.08 | 13.1 | — | 14.32 | 22.71 | 15.82 | 17.29 | 16.29 | 16.59 | 31.9 | — | — | |
| m-Transformer2024.08 | 12.73 | — | 14.58 | 23.11 | 15.82 | 17.24 | 16.44 | 16.65 | 31.91 | — | — |