List your company
ResearchFormerly WizWand

Machine Translation on WMT newstest 2014 (test)

44.3Detokenized BLEUmRASP
22.77228.36133.9539.539Oct 30, 2014Oct 26, 2015Oct 22, 2016Oct 18, 2017Oct 15, 2018Oct 11, 2019Oct 7, 2020
Updated 8mo ago

Evaluation results

MethodLinks
mRASPSize=40M, Fine-tuning=true, Tokenization Protocol=tokenized2020.1044.3
DirectSize=40M, Fine-tuning=true, Tokenization Protocol=tokenized2020.1043.2
CTNMTSize=40M, Fine-tuning=true, Tokenization Protocol=tokenized, Setting=Transformer-base2020.1042.3
mBARTSize=40M, Fine-tuning=true, Tokenization Protocol=tokenized2020.1041
Ensemble of 8 LSTMs + PosUnkArchitecture=Ensemble of 8 LSTMs, Rare Word Handling=PosUnk2014.1036.6
Durrani et al.2014.1035.8
NMTtraining_data=parallel + synthetic, ensemble=42015.1130.8
NMTtraining_data=parallel + synthetic2015.1129.5
PBSMT2015.1128.8
NMTtraining_data=parallel2015.1125.9
NMT (Gülçehre et al., 2015)fusion=deep2015.1124
NMT (Gülçehre et al., 2015)fusion=shallow2015.1123.7
NMT (Gülçehre et al., 2015)fusion=none2015.1123.6