Single-attribute Controllable Text Generation on PPLM 35 Neutral Prompts GPT2-medium base (test)
97.7Sentiment (Avg)FreeCtrl
Evaluation Results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| FreeCtrlMethod Category=Learning-free, Backbone=GPT2-medium, Control Protocol=Single-attribute control2024.06 | 97.7 | 99.9 | 95.4 | 96.5 | 93.7 | 96.1 | 96.5 | 99.6 | 97.3 | 27.2 | 20.2 | 61.3 | 84.1 | |
| PriorControlMethod Category=Learning-based, Backbone=GPT2-medium, Control Protocol=Single-attribute control2024.06 | 97.1 | 99.9 | 94.3 | 95.9 | 95.5 | 99.3 | 90.2 | 98.7 | 90.7 | 54.3 | 29.1 | 70.1 | 86.9 | |
| DiscreteMethod Category=Learning-based, Backbone=GPT2-medium, Control Protocol=Single-attribute control2024.06 | 92.5 | 99.1 | 85.9 | 90.4 | 84.5 | 95 | 84.6 | 97.5 | 90.1 | 46.2 | 36.9 | 76.3 | 87 | |
| Contra. PrefixMethod Category=Learning-based, Backbone=GPT2-medium, Control Protocol=Single-attribute control2024.06 | 89.5 | 88.4 | 90.6 | 86.7 | 74.5 | 85.3 | 93.5 | 93.6 | 93.8 | 37.7 | 17.3 | 47 | 71.1 | |
| GeDiMethod Category=Learning-based, Backbone=GPT2-medium, Control Protocol=Single-attribute control2024.06 | 88.4 | 96.6 | 80.2 | 90.8 | 84.3 | 92.6 | 87.1 | 99.2 | 95.4 | 134.1 | 47.5 | 88.9 | 93 | |
| Mix&MatchMethod Category=Learning-free, Backbone=GPT2-medium, Control Protocol=Single-attribute control2024.06 | 82.8 | 99.2 | 63.3 | 75.6 | 79.5 | 57.4 | 69.6 | 99.3 | 96.9 | 65.2 | 31.5 | 74.8 | 88.8 | |
| PPLMMethod Category=Learning-based, Backbone=GPT2-medium, Control Protocol=Single-attribute control2024.06 | 80 | 97.2 | 62.7 | 70.6 | 74.9 | 46.5 | 62.4 | 98.6 | 93.2 | 63.2 | 31.1 | 70.9 | 85.9 |