Persona Control on FoCus (val)
75.21Controllability SimilarityFine-tuning
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Fine-tuningφ%=100%2023.07 | 75.21 | 37.38 | 25.77 | 5.8 | 6.3 | 27.71 | 24.43 | 0.0793 | 0.382 | 11.28 | |
| Prefix-tuningφ%=6.2%2023.07 | 66.89 | 27.18 | 16.73 | 4.35 | 4.63 | 21.38 | 18.56 | 0.076 | 0.3688 | 11.25 | |
| Controlled DialogPromptPrompt Module=2-layer Transformer, φ%=5.0%2023.07 | 66.34 | 31.85 | 21.67 | 5 | 5.4 | 24.2 | 21.16 | 0.0785 | 0.3786 | 11.24 | |
| Controlled DialogPromptPrompt Module=MLP, φ%=6.2%2023.07 | 64.96 | 26.82 | 17.09 | 4.25 | 4.54 | 21.4 | 18.47 | 0.0785 | 0.3758 | 11.18 | |
| Soft Prompt-tuningφ%=0.008%2023.07 | 62.69 | 18.01 | 9.5 | 2.72 | 2.87 | 16.53 | 13.29 | 0.0677 | 0.3219 | 10.96 | |
| Controlled DialogPromptPrompt Module=Embedding, φ%=8.3%12023.07 | 61.16 | 13.01 | 5.12 | 1.89 | 1.96 | 14.84 | 10.28 | 0.0521 | 0.2645 | 10.82 | |
| Pretrainedφ%=0%2023.07 | 51.4 | 1.63 | 0.42 | 0.02 | 0.02 | 6.62 | 3.67 | 0.0762 | 0.3444 | 10.15 |