Attribute-Controlled Dialogue Generation on DailyDialog-CG (test)
70.66Emotion Accuracy (E-ACC)DCG
Evaluation Results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DCGattribute-oriented prompt=true, task-oriented prompt=true, disentanglement learning=true2023.06 | 70.66 | — | — | — | — | 72.61 | 38.98 | 41.63 | 26.33 | 14.16 | 24.57 | |
| CTRL2023.06 | 67.34 | — | — | — | — | 69.55 | 33.5 | 36.15 | 24.76 | 11.42 | 20.45 | |
| DCG w/o TOPtask-oriented prompt=removed2023.06 | 66.8 | — | — | — | — | 68.02 | 41.83 | 41.5 | 19.18 | 6.74 | 15.63 | |
| Fine-tuningmode=fine-tuning2023.06 | 62.74 | — | — | — | — | 66.77 | 35.66 | 37.02 | 21.64 | 10.19 | 19.15 | |
| CatPrompt2023.06 | 60.91 | — | — | — | — | 66.5 | 36.75 | 38.43 | 24.07 | 11.17 | 20.72 | |
| DCG w/o DLdisentanglement learning=removed2023.06 | 60.41 | — | — | — | — | 64.57 | 38.07 | 39.45 | 22.45 | 9.2 | 19.55 | |
| FUDGE2023.06 | 60.1 | — | — | — | — | 64.29 | 27.21 | 29.21 | 12.24 | 1.13 | 8.67 | |
| Prompt-tuningmode=prompt-tuning2023.06 | 57.06 | — | — | — | — | 62.78 | 30.36 | 32.53 | 19.71 | 7.36 | 15.13 | |
| DCG w/o AOPattribute-oriented prompt=removed, equivalent_to=Prompt-tuning2023.06 | 57.06 | — | — | — | — | 62.78 | 30.36 | 32.53 | 19.71 | 7.36 | 15.13 | |
| CoCon2023.06 | 52.79 | — | — | — | — | 59.99 | 29.44 | 34.51 | 6.91 | 0.42 | 11.5 | |
| PPLM2023.06 | 51.57 | — | — | — | — | 56.87 | 33.6 | 33.71 | 11.77 | 1.34 | 9.26 | |
| DialoGPT-Ori2023.06 | 50.36 | — | — | — | — | 60.46 | 27.82 | 31.61 | 11.53 | 1.58 | 9.03 | |
| CTRLTrainable Parameters=117M, Percent Trainable=100%2023.06 | — | 2.2 | 2.05 | 4.19 | 3.35 | — | — | — | — | — | — | |
| DCGTrainable Parameters=0.66M, Percent Trainable=0.56%2023.06 | — | 2.35 | 2.85 | 4.42 | 3.89 | — | — | — | — | — | — | |
| DCG w/o DLTrainable Parameters=0.66M, Percent Trainable=0.56%2023.06 | — | 1.7 | 2.3 | 4.04 | 3.18 | — | — | — | — | — | — |