Machine Translation on WMT newstest 2014 (test)
44.3Detokenized BLEUmRASP
Evaluation Results
| Method | Links | |
|---|---|---|
| mRASPSize=40M, Fine-tuning=true, Tokenization Protocol=tokenized2020.10 | 44.3 | |
| DirectSize=40M, Fine-tuning=true, Tokenization Protocol=tokenized2020.10 | 43.2 | |
| CTNMTSize=40M, Fine-tuning=true, Tokenization Protocol=tokenized, Setting=Transformer-base2020.10 | 42.3 | |
| mBARTSize=40M, Fine-tuning=true, Tokenization Protocol=tokenized2020.10 | 41 | |
| Ensemble of 8 LSTMs + PosUnkArchitecture=Ensemble of 8 LSTMs, Rare Word Handling=PosUnk2014.10 | 36.6 | |
| Durrani et al.2014.10 | 35.8 | |
| NMTtraining_data=parallel + synthetic, ensemble=42015.11 | 30.8 | |
| NMTtraining_data=parallel + synthetic2015.11 | 29.5 | |
| PBSMT2015.11 | 28.8 | |
| NMTtraining_data=parallel2015.11 | 25.9 | |
| NMT (Gülçehre et al., 2015)fusion=deep2015.11 | 24 | |
| NMT (Gülçehre et al., 2015)fusion=shallow2015.11 | 23.7 | |
| NMT (Gülçehre et al., 2015)fusion=none2015.11 | 23.6 |