Training Data Extraction on The Pile (train)
45Exact Extract RateGPT-Neo 1.3B
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT-Neo 1.3Btheta=0, Prefix Size=50, Suffix Size=50, Prompt Length=12023.05 | 45 | |
| GPT-Neo 125Mtheta=0, Prefix Size=50, Suffix Size=50, Prompt Length=12023.05 | 16.9 | |
| GPT-Neo 1.3Btheta=0.5, Prefix Size=50, Suffix Size=50, Prompt Length=12023.05 | 10.8 | |
| GPT-Neo 125Mtheta=1.25, Prefix Size=50, Suffix Size=50, Prompt Length=12023.05 | 3.1 | |
| GPT-Neo 1.3Btheta=0.75, Prefix Size=50, Suffix Size=50, Prompt Length=12023.05 | 2.2 | |
| GPT2 1.5BPrefix Size=50, Suffix Size=50, Prompt Length=12023.05 | 1.9 | |
| GPT-Neo 1.3Btheta=1, Prefix Size=50, Suffix Size=50, Prompt Length=12023.05 | 1 | |
| GPT-Neo 125Mtheta=1.5, Prefix Size=50, Suffix Size=50, Prompt Length=12023.05 | 0.6 | |
| GPT2 124Mtheta=0, Prefix Size=50, Suffix Size=50, Prompt Length=12023.05 | 0.4 | |
| GPT-Neo 125Mtheta=1.75, Prefix Size=50, Suffix Size=50, Prompt Length=12023.05 | 0.1 |