DialogAct label control on DailyDialog multi-reference (test)
80.25AccuracyFine-tuning
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Fine-tuningφ%=100%2023.07 | 80.25 | 21.03 | 5.7 | 0.96 | 0.98 | 34.38 | 13.05 | 6.02 | 34.51 | 10.21 | |
| Controlled DialogPrompt (2-layer Transformer)φ%=3.3%2023.07 | 78.58 | 19.86 | 5.26 | 1.01 | 1.04 | 33.35 | 12.64 | 5.82 | 33.16 | 10.23 | |
| Controlled DialogPrompt (MLP)φ%=3.1%2023.07 | 78.36 | 19.92 | 5.43 | 0.98 | 1.01 | 33.12 | 12.61 | 5.71 | 32.42 | 10.2 | |
| Prefix-tuningφ%=3.1%2023.07 | 75.02 | 19.94 | 5.12 | 0.91 | 0.93 | 33.29 | 12.54 | 5.59 | 32.46 | 10.17 | |
| Soft Prompt-tuningφ%=0.008%2023.07 | 70.51 | 18.15 | 4.08 | 0.56 | 0.57 | 31.58 | 11.46 | 5.33 | 30.82 | 10.02 | |
| Controlled DialogPrompt (Embedding)φ%=0.001%12023.07 | 69.06 | 20.11 | 4.91 | 0.71 | 0.73 | 32.8 | 12.19 | 5.18 | 30.07 | 10.03 | |
| Pretrainedφ%=0%2023.07 | 58.3 | 10.31 | 1.73 | 0.18 | 0.18 | 19.43 | 7.3 | 7.61 | 40 | 10.03 |