Machine Translation (Chinese-to-English) on NIST 2003 (MT-03)
50.3BLEUManifold
Evaluation Results
| Method | Links | |
|---|---|---|
| ManifoldTotal Parameters=83M, Embedding Parameters=46M2022.11 | 50.3 | |
| AdvAugLoss Config.=L_aut + L_adv, Extra corpora=true2020.06 | 49.81 | |
| StrokeNetTotal Parameters=59M, Embedding Parameters=15M2022.11 | 49.8 | |
| AdvAugLoss Config.=L_clean + L_adv, Extra corpora=false2020.06 | 48.73 | |
| AdvAugTotal Parameters=95M, Embedding Parameters=39M2022.11 | 48 | |
| AdvAugLoss Config.=L_aut + L_adv, Extra corpora=false2020.06 | 47.96 | |
| VanillaTotal Parameters=80M, Embedding Parameters=36M2022.11 | 47.5 | |
| Sennrich et al.Loss Config.=not elaborated, Extra corpora=true2020.06 | 47.1 | |
| Edunov et al.Loss Config.=not elaborated, Extra corpora=true2020.06 | 46.93 | |
| AdvGenTotal Parameters=95M, Embedding Parameters=39M2022.11 | 46.5 | |
| Cheng et al.Loss Config.=not elaborated, Extra corpora=false2020.06 | 46.48 | |
| AdvAugLoss Config.=L_aut, Extra corpora=false2020.06 | 46.13 | |
| Sato et al.Loss Config.=not elaborated, Extra corpora=false2020.06 | 45.02 | |
| AdvAugLoss Config.=L_mixup, Extra corpora=false2020.06 | 44.81 | |
| Miyato et al.Loss Config.=not elaborated, Extra corpora=false2020.06 | 44.68 | |
| Vaswani et al.Loss Config.=L_clean, Extra corpora=false2020.06 | 44.55 | |
| Shared-PrivateTotal Parameters=63M, Embedding Parameters=19M2022.11 | 42 | |
| SAWRBackbone=Transformer, Heads=8, Layers=6, Hidden dimension=5122019.05 | 41.63 | |
| Tree-RNNBackbone=Transformer, Heads=8, Layers=6, Hidden dimension=5122019.05 | 41.24 | |
| Tree-LinearizationBackbone=Transformer, Heads=8, Layers=6, Hidden dimension=5122019.05 | 41.12 | |
| TransformerBackbone=Transformer, Heads=8, Layers=6, Hidden dimension=5122019.05 | 40.45 | |
| RNNSEARCH-COVERAGE + D_RNN + O_CDR# Para.=+1.20M, Speed=0.7K2018.11 | 38.62 | |
| SAWRsyntax-integrated=true2019.05 | 38.42 | |
| Seq2Seq + SACTMechanism=Self-Adaptive Control of Temperature2018.08 | 38.16 | |
| Tree-RNNsyntax-integrated=true2019.05 | 38.12 | |
| Seq2Seq+Attention+DeconvDec2018.06 | 38.04 | |
| RNNSEARCH-COVERAGE# Para.=+1.03M, Speed=1.2K2018.11 | 38.04 | |
| Tree-Linearizationsyntax-integrated=true2019.05 | 37.95 | |
| RNNSEARCH + O_CHRF3# Para.=+0M, Speed=1.1K2018.11 | 37.91 | |
| RNNSEARCH + D_RNN + O_CDR# Para.=+0.17M, Speed=0.8K2018.11 | 37.61 | |
| RNNSEARCH + O_CDR# Para.=+0M, Speed=1.0K2018.11 | 37.42 | |
| RNNSEARCH + MRT_BLEU# Para.=+0M, Speed=0.3K2018.11 | 37.32 | |
| RNNSEARCH + D_CNN# Para.=+0.23M, Speed=1.0K2018.11 | 37.11 | |
| RNNSEARCH + O_BLEU# Para.=+0M, Speed=1.1K2018.11 | 37.02 | |
| RNNSEARCH + D_RNN# Para.=+0.17M, Speed=1.2K2018.11 | 36.96 | |
| Baseline2019.05 | 36.44 | |
| MemDec2018.06 | 36.16 | |
| MemDecType=Attention-based Seq2Seq with external memory2018.08 | 36.16 | |
| RNNSEARCH# Para.=86.7M, Speed=1.4K2018.11 | 36 | |
| Chen et al. (2017b)2019.05 | 35.91 | |
| Chen et al. (2017a)2019.05 | 35.64 | |
| Seq2Seq+Attention2018.06 | 35.32 | |
| Seq2Seq2018.08 | 35.32 | |
| InterAtten2018.06 | 35.09 | |
| Li et al. (2017)2019.05 | 34.9 | |
| Coverage2018.06 | 34.49 | |
| CoverageType=Attention-based Seq2Seq with coverage model2018.08 | 34.49 | |
| Lattice2018.06 | 34.32 | |
| RNNSearch2018.06 | 33.08 | |
| RNNSearchType=Attention-based Seq2Seq2018.08 | 33.08 | |
| Moses2018.06 | 32.43 | |
| MosesType=Phrase-based translation, Language Model=4-gram2018.08 | 32.43 |