Multilingual Many-to-One Machine Translation on TED-59
69.27AZ ScoreMSC
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| MSCNumber of Parameters=45.0M2024.05 | 69.27 | 71.33 | 78.61 | 77.39 | 74.15 | 74.74 | 77.77 | 76.63 | 79.12 | 77.06 | 75.61 | — | |
| TransformerNumber of Parameters=44.3M2024.05 | 68.34 | 70.52 | 78 | 76.49 | 73.34 | 74.13 | 76.88 | 75.82 | 78.43 | 76.31 | 73 | — | |
| Byte-nCFNumber of Parameters=47.0M2024.05 | 67.47 | 70.06 | 78.04 | 76.39 | 72.99 | 74 | 76.93 | 75.65 | 78.67 | 76.32 | 74.65 | — | |
| MSCTokenization=Byte, Parameters=45.0M2024.05 | 13.24 | 22.1 | 31.98 | 28.39 | 23.93 | 26.33 | 31.02 | 31.29 | 33.63 | 30.57 | — | 24.3 | |
| TransformerTokenization=Byte, Parameters=44.3M2024.05 | 12.61 | 21.41 | 31.08 | 27.64 | 23.19 | 25.6 | 30.14 | 30.38 | 32.97 | 29.77 | — | 23.63 | |
| Byte-nCFTokenization=Byte, Parameters=47.0M2024.05 | 12.46 | 21.51 | 31.44 | 27.65 | 23.26 | 25.89 | 30.56 | 30.55 | 33.34 | 30.08 | — | 23.7 | |
| LearnedTokenization=Subword, Parameters=60.6M2024.05 | 11.58 | 18.83 | 26.81 | 24.93 | 20.54 | 23.35 | 26.33 | 27.09 | 28.45 | 26.31 | — | 21.44 | |
| Aharoni*Tokenization=Subword, Parameters=~93M2024.05 | 11.24 | 18.28 | 28.63 | 26.78 | 21.23 | 25.93 | 28.87 | 30.19 | 32.42 | 29.35 | — | — | |
| mBARTTokenization=Subword, Parameters=172.2M2024.05 | 10.24 | 15.41 | 28.2 | 24.76 | 19.65 | 22.57 | 27.78 | 26.59 | 30.36 | 26.83 | — | 21.15 |