Data Extraction on GPT-2 (train)
0.48Pearson rAttenMIA
Evaluation Results
| Method | Links | |
|---|---|---|
| AttenMIATarget Model=GPT-2 XL2026.01 | 0.48 | |
| ratio_zlib_xlReference Metric=Zlib, Target Model=GPT-2 XL2026.01 | 0.321 | |
| ratio_lower_xlReference Metric=Lowercase, Target Model=GPT-2 XL2026.01 | 0.07 | |
| ratio_s_xlReference Metric=Small Model, Target Model=GPT-2 XL2026.01 | 0.048 | |
| zlib_entropy2026.01 | -0.092 | |
| ppl_xlTarget Model=GPT-2 XL2026.01 | -0.206 | |
| ppl_lowerReference Metric=Lowercase, Target Model=GPT-2 XL2026.01 | -0.238 | |
| ppl_sReference Metric=Small Model, Target Model=GPT-2 XL2026.01 | -0.256 |