Open-ended text generation on Wikitext-103 v1
98.7DiversityGPT-4
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GPT-42023.10 | 98.7 | 45.3 | 67.2 | |
| InferDPT + RANTEXTPrivacy parameter (ε)=2.02023.10 | 96.2 | 25.4 | 74.4 | |
| InferDPT + CUSTEXT+Privacy parameter (ε)=2.02023.10 | 96.1 | 31.5 | 73.6 | |
| InferDPT + RANTEXTPrivacy parameter (ε)=1.02023.10 | 96.1 | 24.5 | 72.9 | |
| InferDPT + RANTEXTPrivacy parameter (ε)=3.02023.10 | 96.1 | 27.4 | 74.5 | |
| InferDPT + CUSTEXT+Privacy parameter (ε)=1.02023.10 | 96 | 30.1 | 72.7 | |
| InferDPT + SANTEXT+Privacy parameter (ε)=3.02023.10 | 95.9 | 25.5 | 67.8 | |
| InferDPT + CUSTEXT+Privacy parameter (ε)=3.02023.10 | 95.9 | 32.1 | 74.1 | |
| InferDPT + SANTEXT+Privacy parameter (ε)=1.02023.10 | 95.8 | 21.3 | 65 | |
| InferDPT + SANTEXT+Privacy parameter (ε)=2.02023.10 | 95.8 | 22 | 65.8 | |
| Vicuna-7b-4bit (3.89GB)2023.10 | 91.6 | 15.8 | 66.3 |