Machine Translation on IWSLT 2014 DE-EN
37.95BLEU ScoreDRDA
Evaluation Results
| Method | Links | |
|---|---|---|
| DRDAgranularity=dynamic2024.06 | 37.95 | |
| DRDAgranularity=static2024.06 | 37.9 | |
| CODA#Params.=39.48M2021.05 | 35.6 | |
| Knee scheduleBackbone=Transformers, Training Budget=50 epochs2020.03 | 35.53 | |
| Transformer2024.06 | 35.26 | |
| Knee scheduleBackbone=Transformers, Training Budget=50 epochs, Explore strategy=Fixed 50%2020.03 | 35.23 | |
| Cosine DecayBackbone=Transformers, Training Budget=50 epochs2020.03 | 35.21 | |
| Masked Label Smoothing (MLS)Vocabulary Sharing=true2022.03 | 35.04 | |
| BaselineBackbone=Transformers, Training Budget=50 epochs2020.03 | 34.97 | |
| Linear DecayBackbone=Transformers, Training Budget=50 epochs2020.03 | 34.97 | |
| One-Cycle DecayBackbone=Transformers, Training Budget=50 epochs2020.03 | 34.77 | |
| TransformerVocabulary Sharing=false, Label Smoothing=true2022.03 | 34.76 | |
| TransformerVocabulary Sharing=true, Label Smoothing=true2022.03 | 34.56 | |
| TRANSFORMER#Params.=39.47M2021.05 | 34.5 | |
| TransformerVocabulary Sharing=true, Label Smoothing=false2022.03 | 33.83 | |
| Meta-DiffuBD_theta=Dinoiser2024.10 | 33.82 | |
| TransformerVocabulary Sharing=false, Label Smoothing=false2022.03 | 33.54 | |
| Meta-DiffuBD_theta=SeqDiffuSeq2024.10 | 32.41 | |
| Meta-DiffuBD_theta=DiffuSeq2024.10 | 31.71 | |
| Dinoiser2024.10 | 31.61 | |
| SeqDiffuSeq2024.10 | 30.16 | |
| DiffuSeq2024.10 | 29.43 |