Inferential Text Generation on ATOMIC (test)
15.4Overall ScoreEA-VQ-VAE
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| EA-VQ-VAELearning approach=Multi Task2020.06 | 15.4 | 26.89 | 25.95 | 5.72 | 10.96 | 5.68 | 25.94 | 8.78 | 6.1 | 22.48 | — | — | — | |
| COMETLearning approach=Multi Task, Re-implementation=false2020.06 | 15.1 | — | — | — | — | — | — | — | — | — | — | — | — | |
| COMETLearning approach=Multi Task, Re-implementation=true2020.06 | 15 | 25.82 | 25.54 | 5.39 | 10.39 | 5.36 | 26.41 | 8.43 | 5.65 | 21.96 | — | — | — | |
| S2SLearning approach=Multi Task, Re-implementation=true2020.06 | 14.2 | 24.53 | 23.85 | 5.06 | 9.44 | 5.38 | 24.68 | 7.93 | 5.6 | 21.3 | — | — | — | |
| CWVAELearning approach=Single Task, Re-implementation=false2020.06 | 11.69 | 12.12 | 15.67 | 5.63 | 14.64 | 8.13 | 15.01 | 11.63 | 8.58 | 13.83 | — | — | — | |
| VRNMTLearning approach=Single Task, Re-implementation=false2020.06 | 8.82 | 9.52 | 13.35 | 4.87 | 4.42 | 7.64 | 9.8 | 13.71 | 5.28 | 10.79 | — | — | — | |
| S2SLearning approach=Single Task, Re-implementation=false2020.06 | 7.02 | 8.17 | 12.35 | 2.96 | 5.26 | 3.43 | 13.44 | 6.42 | 4.09 | 7.08 | — | — | — | |
| COMETre-implementation=true2020.06 | — | — | — | — | — | — | — | — | — | — | 63.79 | — | — | |
| COMETTraining Protocol=Multi-task, Re-implementation=true2020.06 | — | — | — | — | — | — | — | — | — | — | — | 3,629 | 12,826 | |
| EA-VQ-VAE2020.06 | — | — | — | — | — | — | — | — | — | — | 65.28 | — | — | |
| EA-VQ-VAETraining Protocol=Multi-task2020.06 | — | — | — | — | — | — | — | — | — | — | — | 3,918 | 14,278 | |
| S2Sre-implementation=true2020.06 | — | — | — | — | — | — | — | — | — | — | 51.74 | — | — | |
| S2STraining Protocol=Multi-task, Re-implementation=true2020.06 | — | — | — | — | — | — | — | — | — | — | — | 2,193 | 5,761 |