Neural Machine Translation on IWSLT and WMT (test)
6.08PPLVariational Attention
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Variational AttentionObjective=Eq [log p] - KL, Expectation calculation=Enum2018.07 | 6.08 | 33.68 | |
| Variational AttentionObjective=Eq [log p] - KL, Expectation calculation=Sample2018.07 | 6.17 | 33.3 | |
| Marginal LikelihoodObjective=log E[p], Expectation calculation=Enum2018.07 | 6.34 | 33.29 | |
| Soft AttentionObjective=log p(y | E[z]), Expectation calculation=N/A2018.07 | 7.17 | 32.77 | |
| Hard AttentionObjective=Ep [log p], Expectation calculation=Enum2018.07 | 7.37 | 31.4 | |
| Hard AttentionObjective=Ep [log p], Expectation calculation=Sample2018.07 | 7.38 | 31 | |
| Variational Relaxed AttentionObjective=Eq [log p] - KL, Expectation calculation=Sample2018.07 | 7.58 | 30.05 |