Code Generation on Java dataset (test)
27.53BLEUMAT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MATρ=0.1, Na=4, d=256, dh=1024, number of parameters=37M2020.06 | 27.53 | 88.9 | |
| MATρ=0, Na=4, d=256, dh=1024, number of parameters=37M2020.06 | 26.97 | 77.5 | |
| MATρ=0.2, Na=4, d=256, dh=1024, number of parameters=37M2020.06 | 26.06 | 90.8 | |
| MATρ=0.3, Na=4, d=256, dh=1024, number of parameters=37M2020.06 | 24.72 | 90.2 | |
| Transformerd=512, dh=1024, number of parameters=55M2020.06 | 23.3 | 83.1 | |
| Dual2020.06 | 17.17 | 27.4 |