Data Extraction on The Pile (test)
63.4Fractional Extraction RateGPT-Neo 1.3B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GPT-Neo 1.3Btheta=0 (no defense)2023.05 | 63.4 | 9.213 | |
| GPT-Neo 125Mtheta=0 (no defense)2023.05 | 35 | 15.71 | |
| GPT-Neo 1.3Btheta=0.52023.05 | 31.6 | 9.758 | |
| GPT-Neo 125Mtheta=1.252023.05 | 19.2 | 16.601 | |
| GPT-Neo 1.3Btheta=0.752023.05 | 17.1 | 10.267 | |
| GPT2 1.5B2023.05 | 16.6 | 17.155 | |
| GPT-Neo 1.3Btheta=12023.05 | 12.8 | 10.775 | |
| GPT-Neo 125Mtheta=1.52023.05 | 12.3 | 17.499 | |
| GPT2 124M2023.05 | 9.9 | 30.323 | |
| GPT-Neo 125Mtheta=1.752023.05 | 8.7 | 19.691 |