Machine Translation on IWSLT'14 DE-EN (val)
4.13Validation PPLCutoff
Evaluation results
| Method | Links | |
|---|---|---|
| CutoffLR Schedule=Knee, Training Epochs=1002020.03 | 4.13 | |
| CutoffLR Schedule=Knee (short budget), Training Epochs=702020.03 | 4.18 | |
| CutoffLR Schedule=Inv. Sqrt, Training Epochs=1002020.03 | 4.24 | |
| CutoffLR Schedule=Inv. Sqrt (short budget), Training Epochs=702020.03 | 4.29 | |
| Knee scheduleLR Schedule=Knee schedule, Architecture=Transformer, Training Epochs=502020.03 | 4.86 | |
| Cosine DecayLR Schedule=Cosine Decay, Architecture=Transformer, Training Epochs=502020.03 | 4.88 | |
| Knee scheduleLR Schedule=Knee schedule, Training Budget=35 epochs2020.03 | 4.9 | |
| Linear DecayLR Schedule=Linear Decay, Architecture=Transformer, Training Epochs=502020.03 | 4.92 | |
| One-CycleLR Schedule=One-Cycle, Architecture=Transformer, Training Epochs=502020.03 | 4.97 | |
| Cosine DecayLR Schedule=Cosine Decay, Training Budget=35 epochs2020.03 | 5.06 | |
| One-CycleLR Schedule=One-Cycle, Training Budget=35 epochs2020.03 | 5.09 | |
| Linear DecayLR Schedule=Linear Decay, Training Budget=35 epochs2020.03 | 5.14 |