Machine Translation on WMT De-En 14 (test)
34.19BLEUBPE-dropout
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| BPE-dropoutSegmentation=BPE-dropout2019.10 | 34.19 | — | — | |
| Kudo (2018)Segmentation=Unigram Language Model2019.10 | 33.65 | — | — | |
| BPESegmentation=BPE2019.10 | 32.69 | — | — | |
| LATIterations=4, latency (ms)=732020.11 | 32.04 | — | — | |
| ATIterations=N, latency (ms)=4862020.11 | 31.87 | — | — | |
| FullyNAT + CTC + GLATCategory=Alignment-Based, Inference mode=single-step2022.06 | 31.4 | — | — | |
| DATCategory=Alignment-Based, Inference mode=single-step2022.06 | 31.3 | — | — | |
| CMLMC + DiMSCategory=Proposed, Inference mode=single-step2022.06 | 31.1 | — | — | |
| JM-NATIdec=102020.08 | 31.02 | — | 5.7 | |
| GLAT + NPDIdec=1, m=72020.08 | 31.02 | — | 7.9 | |
| Flowseq + NPDIdec=1, m=302020.08 | 30.68 | — | — | |
| CMLMIterations=10, latency (ms)=1662020.11 | 30.53 | — | — | |
| Mask-PredictIdec=10, type=Iterative NAT2020.08 | 30.53 | — | 1.7 | |
| AlignNARTCategory=Alignment-Based, Inference mode=single-step2022.06 | 30.4 | — | — | |
| OAXECategory=Alignment-Based, Inference mode=single-step2022.06 | 30.2 | — | — | |
| LATIterations=1, latency (ms)=312020.11 | 29.91 | — | — | |
| CMLMIterations=4, latency (ms)=722020.11 | 29.9 | — | — | |
| GLATIdec=12020.08 | 29.84 | — | 15.3 | |
| GLATCategory=XE-Based, Inference mode=single-step2022.06 | 29.8 | — | — | |
| NAT-DCRF + NPDIdec=1, m=92020.08 | 29.68 | — | 6.1 | |
| GLAT + CTCIdec=12020.08 | 29.54 | — | 14.6 | |
| NAT-HINT + NPDIdec=1, m=92020.08 | 29.52 | — | — | |
| CTC*Idec=12020.08 | 28.73 | — | 14.6 | |
| ImputerIdec=12020.08 | 28.4 | — | 18.6 | |
| ImputerCategory=Alignment-Based, Inference mode=single-step2022.06 | 28.4 | — | — | |
| FlowseqIdec=12020.08 | 28.39 | — | 1.1 | |
| ENGINECategory=XE-Based, Inference mode=single-step2022.06 | 28.1 | — | — | |
| EM+ODDCategory=XE-Based, Inference mode=single-step2022.06 | 27.9 | — | — | |
| AXECategory=Alignment-Based, Inference mode=single-step2022.06 | 27.9 | — | — | |
| Transformerimplementation=ours2020.08 | 27.48 | — | 1 | |
| imit-NAT + NPDIdec=1, m=72020.08 | 27.28 | — | 9.7 | |
| NAT-DCRFIdec=12020.08 | 27.22 | — | 10.4 | |
| Bigram CRFCategory=XE-Based, Inference mode=single-step2022.06 | 27.2 | — | — | |
| Autoregressivebeam size=42017.11 | 27.02 | 607 | 1 | |
| Autoregressivebeam size=12017.11 | 26.39 | 408 | 1.49 | |
| CNATDecoding=argmax decoding2021.03 | 25.73 | — | — | |
| imit-NATIdec=12020.08 | 25.67 | — | 18.6 | |
| SynSTDecoding=argmax decoding2021.03 | 25.5 | — | — | |
| NAT-IRIdec=102020.08 | 25.48 | — | 1.5 | |
| FlowseqDecoding=argmax decoding2021.03 | 25.4 | — | — | |
| NAT-HINTIdec=12020.08 | 25.24 | — | — | |
| Hint-based LossCategory=XE-Based, Inference mode=single-step2022.06 | 25.2 | — | — | |
| AXE CMLMDecoding=argmax decoding2021.03 | 24.9 | — | — | |
| NAT-base*Idec=12020.08 | 24.81 | — | 15.3 | |
| Aux. Reg.Category=XE-Based, Inference mode=single-step2022.06 | 24.8 | — | — | |
| Bag-of-ngramCategory=XE-Based, Inference mode=single-step2022.06 | 24.6 | — | — | |
| SMARTCategory=XE-Based, Inference mode=single-step2022.06 | 23.8 | — | — | |
| CMLMCCategory=XE-Based, Inference mode=single-step2022.06 | 23.6 | — | — | |
| NATdecoding=Noisy Parallel Decoding, fine-tuning=true, sample size=1002017.11 | 23.2 | 257 | 2.36 | |
| NAT-FT + NPDIdec=1, m=1002020.08 | 23.2 | — | 2.4 | |
| NATdecoding=Noisy Parallel Decoding, fine-tuning=true, sample size=102017.11 | 22.41 | 79 | 7.68 | |
| CMLMIterations=1, latency (ms)=272020.11 | 21.83 | — | — | |
| Mask-PredictIdec=1, type=Fully NAT2020.08 | 21.83 | — | — | |
| CMLMCategory=XE-Based, Inference mode=single-step2022.06 | 21.8 | — | — | |
| NATdecoding=argmax, fine-tuning=true2017.11 | 21.47 | 39 | 15.6 | |
| NAT-FTIdec=12020.08 | 21.47 | — | 15.6 | |
| NATdecoding=argmax2017.11 | 20.62 | 39 | 15.6 | |
| NAT-CTCIdec=12020.08 | 18.64 | — | — | |
| NAT (ours)Decoding=argmax decoding2021.03 | 11.02 | — | — |