Machine Translation on WMT en-de
30.17BLEUdenoising dequantization transform
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| denoising dequantization transformPrecision=A4W4, Steps=100k2024.09 | 30.17 | — | — | |
| denoising dequantization transformPrecision=A4W2, Steps=100k2024.09 | 30.03 | — | — | |
| TransformerPrecision=A32W32, Steps=100k2024.09 | 29.8 | — | — | |
| denoising dequantization transformPrecision=A4W4, Steps=25k2024.09 | 29.71 | — | — | |
| TransformerPrecision=A32W32, Steps=25k2024.09 | 29.49 | — | — | |
| LayerNorm (Ott et al., 2018)Normalization=true2019.01 | 29.3 | — | — | |
| Fixup-initNormalization=false2019.01 | 29.3 | — | — | |
| denoising dequantization transformPrecision=A2W2, Steps=100k2024.09 | 28.61 | — | — | |
| denoising dequantization transformPrecision=A4W2, Steps=25k2024.09 | 28.58 | — | — | |
| Vaswani et al. (2017)Normalization=true2019.01 | 28.4 | — | — | |
| denoising dequantization transformPrecision=A4W1, Steps=100k2024.09 | 28.32 | — | — | |
| denoising dequantization transformPrecision=A2W2, Steps=25k2024.09 | 27.56 | — | — | |
| denoising dequantization transformPrecision=A2W1, Steps=100k2024.09 | 27.4 | — | — | |
| denoising dequantization transformPrecision=A4W1, Steps=25k2024.09 | 27.06 | — | — | |
| denoising dequantization transformPrecision=A2W1, Steps=25k2024.09 | 26 | — | — | |
| denoising dequantization transformPrecision=A1W1, Steps=100k2024.09 | 23.64 | — | — | |
| denoising dequantization transformPrecision=A1W1, Steps=25k2024.09 | 21.42 | — | — | |
| SupervisedDecoding=greedy, Supervision=supervised2017.10 | 21.33 | — | — | |
| oracle word reorderingDecoding=greedy, Supervision=unsupervised2017.10 | 11.57 | — | — | |
| Our modelDecoding=greedy, Iteration=2nd, Supervision=unsupervised2017.10 | 9.75 | — | — | |
| Our modelDecoding=greedy, Iteration=3rd, Supervision=unsupervised2017.10 | 9.64 | — | — | |
| Our modelDecoding=greedy, Iteration=1st, Supervision=unsupervised2017.10 | 8.86 | — | — | |
| word-by-wordDecoding=greedy, Supervision=unsupervised2017.10 | 7.06 | — | — | |
| word reorderingDecoding=greedy, Supervision=unsupervised2017.10 | 6.7 | — | — | |
| Fixed-PointGE=Y, PT=Y, Clip=Y, LB=42024.09 | — | 28.48 | 26.94 | |
| GradScaleGE=Y, PT=N, Clip=N, LB=42024.09 | — | 27.5 | 25.9 | |
| LSQ+LUQGE=Y, PT=N, Clip=Y, LB=42024.09 | — | 27.5 | 27.17 | |
| LUQ+SMPGE=N, PT=Y, Clip=Y, LB=42024.09 | — | 27.5 | 27.25 | |
| OursGE=N, PT=N, Clip=N, LB=12024.09 | — | 29.49 | 29.71 |