Conversational Question Generation on Reddit CQG (test)
54.8FluencyGTM
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GTMfull model=true2021.06 | 54.8 | 60.8 | 52.6 | — | — | — | — | — | — | — | — | — | — | — | |
| GTMvariant=z^s and z^a2021.06 | 54.2 | 58.6 | 52 | — | — | — | — | — | — | — | — | — | — | — | |
| GTMvariant=z^s only2021.06 | 53.8 | 58 | 51.6 | — | — | — | — | — | — | — | — | — | — | — | |
| RL-CVAE2021.06 | 53.4 | 57.8 | 50.8 | — | — | — | — | — | — | — | — | — | — | — | |
| GTMvariant=z^a only2021.06 | 53.2 | 57 | 51.2 | — | — | — | — | — | — | — | — | — | — | — | |
| HTD2021.06 | 52.6 | 50.4 | 41.4 | — | — | — | — | — | — | — | — | — | — | — | |
| STD2021.06 | 48.8 | 35.6 | 28.6 | — | — | — | — | — | — | — | — | — | — | — | |
| S2S-Attn2021.06 | 48.2 | 21.6 | 18.6 | — | — | — | — | — | — | — | — | — | — | — | |
| kgCVAE2021.06 | 47.4 | 53.6 | 47.6 | — | — | — | — | — | — | — | — | — | — | — | |
| CVAE2021.06 | 46.2 | 48.4 | 42.8 | — | — | — | — | — | — | — | — | — | — | — | |
| CVAE2021.06 | — | — | — | 64.6 | 33.7 | 42.1 | 1.6 | 15.99 | 14.22 | 3.06 | 64.9 | 68.7 | — | — | |
| CVAE2021.06 | — | — | — | — | — | — | — | — | — | — | — | — | 56.4 | 8.047 | |
| GTMvariant=z^t2021.06 | — | — | — | 67.2 | 35.1 | 44.8 | 1.65 | 18.72 | 15.21 | 3.32 | 66.1 | 71 | — | — | |
| GTMvariant=a2021.06 | — | — | — | 65.3 | 33.8 | 42.8 | 1.58 | 16.79 | 14.82 | 3.17 | 65.7 | 69.2 | — | — | |
| GTMvariant=z^q / z^a2021.06 | — | — | — | 68.7 | 36 | 44.9 | 1.7 | 19.34 | 15.28 | 3.29 | 66.9 | 71.3 | — | — | |
| GTMvariant=Full Model2021.06 | — | — | — | 69.7 | 36.5 | 45.4 | 1.76 | 20.28 | 15.37 | 3.31 | 67.1 | 72 | — | — | |
| GTMdescription=Full proposed model2021.06 | — | — | — | — | — | — | — | — | — | — | — | — | 62.9 | 8.517 | |
| GTM-z^alatent_variable=z^a2021.06 | — | — | — | — | — | — | — | — | — | — | — | — | 60.5 | 8.424 | |
| GTM-z^platent_variable=z^p2021.06 | — | — | — | — | — | — | — | — | — | — | — | — | 61.3 | 8.427 | |
| GTM-z^p/z^alatent_variable_relationship=z^p and z^a2021.06 | — | — | — | — | — | — | — | — | — | — | — | — | 61.8 | 8.472 | |
| HTD2021.06 | — | — | — | 64.8 | 33 | 42.3 | 1.54 | 15.82 | 14.75 | 3.14 | 65.3 | 68.9 | — | — | |
| HTD2021.06 | — | — | — | — | — | — | — | — | — | — | — | — | 58.3 | 8.059 | |
| kgCVAE2021.06 | — | — | — | 64.7 | 33.2 | 42.5 | 1.53 | 15.87 | 14.91 | 3.1 | 65 | 68.2 | — | — | |
| kgCVAE2021.06 | — | — | — | — | — | — | — | — | — | — | — | — | 57.8 | 8.054 | |
| RL-CVAE2021.06 | — | — | — | 66.2 | 34.3 | 43.7 | 1.61 | 17.85 | 15.03 | 3.2 | 66 | 70.1 | — | — | |
| RL-CVAE2021.06 | — | — | — | — | — | — | — | — | — | — | — | — | 60.7 | 8.423 | |
| S2S-Attn2021.06 | — | — | — | 63.4 | 32.2 | 41.3 | 1.32 | 8.3 | 9.36 | 2.98 | 58.4 | 62.2 | — | — | |
| S2S-Attn2021.06 | — | — | — | — | — | — | — | — | — | — | — | — | 49.8 | 5.306 | |
| STD2021.06 | — | — | — | 63.7 | 32.6 | 41.8 | 1.44 | 13.25 | 13.27 | 3.02 | 63.3 | 66.3 | — | — | |
| STD2021.06 | — | — | — | — | — | — | — | — | — | — | — | — | 54.2 | 6.879 |