Machine Translation on NIST MT 04 2004 (test)
0.5061BLEUAdvAug
Evaluation Results
| Method | Links | |
|---|---|---|
| AdvAugLoss Config.=L_aut + L_adv, Extra corpora=true2020.06 | 0.5061 | |
| AdvAugLoss Config.=L_aut + L_adv, Extra corpora=false2020.06 | 0.4886 | |
| AdvAugLoss Config.=L_clean + L_adv, Extra corpora=false2020.06 | 0.486 | |
| Sennrich et al.Loss Config.=not elaborated, Extra corpora=true2020.06 | 0.4781 | |
| Edunov et al.Loss Config.=not elaborated, Extra corpora=true2020.06 | 0.478 | |
| AdvAugLoss Config.=L_aut, Extra corpora=false2020.06 | 0.4754 | |
| Cheng et al.Loss Config.=not elaborated, Extra corpora=false2020.06 | 0.4739 | |
| AdvAugLoss Config.=L_mixup, Extra corpora=false2020.06 | 0.4661 | |
| Sato et al.Loss Config.=not elaborated, Extra corpora=false2020.06 | 0.4649 | |
| Vaswani et al.Loss Config.=L_clean, Extra corpora=false2020.06 | 0.462 | |
| Miyato et al.Loss Config.=not elaborated, Extra corpora=false2020.06 | 0.4599 | |
| RNNSEARCH-COVERAGE + D_RNN + O_CDR# Para.=+1.20M, Speed=0.7K2018.11 | 0.4198 | |
| RNNSEARCH-COVERAGE# Para.=+1.03M, Speed=1.2K2018.11 | 0.4109 | |
| Seq2Seq + SACTMechanism=Self-Adaptive Control of Temperature2018.08 | 0.4048 | |
| RNNSEARCH + D_RNN + O_CDR# Para.=+0.17M, Speed=0.8K2018.11 | 0.4005 | |
| MemDecType=Attention-based Seq2Seq with external memory2018.08 | 0.3981 | |
| RNNSEARCH + O_CHRF3# Para.=+0M, Speed=1.1K2018.11 | 0.398 | |
| RNNSEARCH + O_CDR# Para.=+0M, Speed=1.0K2018.11 | 0.3952 | |
| RNNSEARCH + MRT_BLEU# Para.=+0M, Speed=0.3K2018.11 | 0.3941 | |
| RNNSEARCH + D_RNN# Para.=+0.17M, Speed=1.2K2018.11 | 0.3892 | |
| RNNSEARCH + D_CNN# Para.=+0.23M, Speed=1.0K2018.11 | 0.3884 | |
| RNNSEARCH + O_BLEU# Para.=+0M, Speed=1.1K2018.11 | 0.3849 | |
| CoverageType=Attention-based Seq2Seq with coverage model2018.08 | 0.3834 | |
| RNNSEARCH# Para.=86.7M, Speed=1.4K2018.11 | 0.3826 | |
| Seq2Seq2018.08 | 0.3725 | |
| RNNSearchType=Attention-based Seq2Seq2018.08 | 0.3532 | |
| MosesType=Phrase-based translation, Language Model=4-gram2018.08 | 0.3414 |