Machine Translation on WMT newstest 2016 (test)
40.4BLEUdir + lm + big
Evaluation Results
| Method | Links | |
|---|---|---|
| dir + lm + bigmono tokens En (B)=4.5, mono tokens Ro (B)=22, language_model=true, channel_model_size=big, beam=50, backtranslation=true2020.11 | 40.4 | |
| mBART02mono tokens En (B)=66, mono tokens Ro (B)=66, backtranslation=true2020.11 | 39.9 | |
| mBART02mono tokens En (B)=66, mono tokens Ro (B)=66, backtranslation=true, beam=502020.11 | 39.9 | |
| dir + lm + bigmono tokens En (B)=4.5, mono tokens Ro (B)=22, language_model=true, channel_model_size=big, backtranslation=true2020.11 | 39.6 | |
| dir + lm + bigmono tokens En (B)=4.5, mono tokens Ro (B)=22, language_model=true, channel_model_size=big, beam=502020.11 | 39.1 | |
| dir + lm + bigmono tokens En (B)=4.5, mono tokens Ro (B)=22, language_model=true, channel_model_size=big, beam=502020.11 | 39.1 | |
| dir + lmmono tokens En (B)=4.5, mono tokens Ro (B)=22, language_model=true, backtranslation=true2020.11 | 38.7 | |
| mBART02mono tokens En (B)=66, mono tokens Ro (B)=662020.11 | 38.5 | |
| mBART02mono tokens En (B)=66, mono tokens Ro (B)=662020.11 | 38.5 | |
| dirmono tokens En (B)=-, mono tokens Ro (B)=-, backtranslation=true2020.11 | 38.4 | |
| dir + lm + bigmono tokens En (B)=4.5, mono tokens Ro (B)=22, language_model=true, channel_model_size=big2020.11 | 37.7 | |
| dir + lm + bigmono tokens En (B)=4.5, mono tokens Ro (B)=22, language_model=true, channel_model_size=big2020.11 | 37.3 | |
| dir + lmmono tokens En (B)=4.5, mono tokens Ro (B)=22, language_model=true2020.11 | 35.9 | |
| dir + lmmono tokens En (B)=4.5, mono tokens Ro (B)=22, language_model=true2020.11 | 35.4 | |
| B2T connectionEnc-Dec layers=18L-18L2022.06 | 34.93 | |
| B2T connectionEnc-Dec layers=6L-6L2022.06 | 34.73 | |
| T-FixupEnc-Dec layers=18L-18L2022.06 | 34.69 | |
| dirmono tokens En (B)=-, mono tokens Ro (B)=-2020.11 | 34.6 | |
| dirmono tokens En (B)=-, mono tokens Ro (B)=-2020.11 | 34.6 | |
| T-FixupEnc-Dec layers=6L-6L2022.06 | 34.56 | |
| Post-LNEnc-Dec layers=6L-6L2022.06 | 34.4 | |
| DeepNetEnc-Dec layers=6L-6L2022.06 | 34.39 | |
| DLCLEnc-Dec layers=6L-6L2022.06 | 34.26 | |
| DeepNetEnc-Dec layers=18L-18L2022.06 | 34.25 | |
| Pre-LNEnc-Dec layers=18L-18L2022.06 | 34.16 | |
| RealFormerEnc-Dec layers=6L-6L2022.06 | 34.15 | |
| AdminEnc-Dec layers=6L-6L2022.06 | 34.12 | |
| DLCLEnc-Dec layers=18L-18L2022.06 | 33.98 | |
| AdminEnc-Dec layers=18L-18L2022.06 | 33.88 | |
| Pre-LNEnc-Dec layers=6L-6L2022.06 | 33.84 | |
| RealFormerEnc-Dec layers=18L-18L2022.06 | 33.71 |