Open-ended text generation on CNN/Daily Mail
98.3DiversityGPT-4
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GPT-42023.10 | 98.3 | 0.671 | 63.2 | |
| InferDPT + RANTEXTPrivacy parameter (ε)=3.02023.10 | 97.1 | 0.587 | 73.6 | |
| InferDPT + RANTEXTPrivacy parameter (ε)=1.02023.10 | 97 | 0.542 | 72.3 | |
| InferDPT + RANTEXTPrivacy parameter (ε)=2.02023.10 | 97 | 0.563 | 73.5 | |
| InferDPT + SANTEXT+Privacy parameter (ε)=2.02023.10 | 96.7 | 0.374 | 63.2 | |
| InferDPT + CUSTEXT+Privacy parameter (ε)=2.02023.10 | 96.7 | 0.571 | 73.3 | |
| InferDPT + SANTEXT+Privacy parameter (ε)=1.02023.10 | 96.6 | 0.351 | 59 | |
| InferDPT + SANTEXT+Privacy parameter (ε)=3.02023.10 | 96.6 | 0.407 | 64.2 | |
| InferDPT + CUSTEXT+Privacy parameter (ε)=1.02023.10 | 96.6 | 0.54 | 72.6 | |
| InferDPT + CUSTEXT+Privacy parameter (ε)=3.02023.10 | 96.5 | 0.581 | 75.2 | |
| Vicuna-7b-4bit (3.89GB)2023.10 | 94.3 | 0.197 | 62.7 |