Machine Translation on IWSLT DE-EN 2014 (dev)
35.66BLEUAdam+ASAM
Evaluation Results
| Method | Links | |
|---|---|---|
| Adam+ASAMArchitecture=Transformer, Base Optimizer=Adam2021.02 | 35.66 | |
| Adam+SAMArchitecture=Transformer, Base Optimizer=Adam2021.02 | 35.52 | |
| AdamArchitecture=Transformer, Base Optimizer=Adam2021.02 | 35.34 | |
| LATIterations=4, Parameter size=64M2020.11 | 34.05 | |
| ATIterations=N, Parameter size=60M2020.11 | 33.59 | |
| CMLMIterations=10, Parameter size=62M2020.11 | 33.23 | |
| CMLMIterations=4, Parameter size=62M2020.11 | 29.06 | |
| LATIterations=1, Parameter size=64M2020.11 | 28.34 | |
| CMLMIterations=1, Parameter size=62M2020.11 | 24.57 |