Membership Inference Attack on Pile CC Pythia
71ROC AUCAttenMIA (Perturbed)
Evaluation results
| Method | Links | |
|---|---|---|
| AttenMIA (Perturbed)Model size=6.9b2026.01 | 71 | |
| AttenMIA (Perturbed)Model size=2.8b2026.01 | 70 | |
| AttenMIA (Perturbed)Model size=1.4b2026.01 | 66 | |
| AttenMIA (Transitional)Model size=1.4b2026.01 | 59 | |
| AttenMIA (Transitional)Model size=2.8b2026.01 | 58 | |
| AttenMIA (Transitional)Model size=6.9b2026.01 | 56 | |
| PETALModel size=2.8b2026.01 | 55 | |
| PPL attackModel size=6.9b2026.01 | 54 | |
| PETALModel size=1.4b2026.01 | 54 | |
| PETALModel size=6.9b2026.01 | 54 | |
| PPL attackModel size=2.8b2026.01 | 53 | |
| reference attackModel size=6.9b2026.01 | 53 | |
| PPL attackModel size=1.4b2026.01 | 52 | |
| zlib attackModel size=2.8b2026.01 | 52 | |
| zlib attackModel size=6.9b2026.01 | 52 | |
| MIN-K% PROBModel size=1.4b2026.01 | 52 | |
| MIN-K% PROBModel size=2.8b2026.01 | 52 | |
| MIN-K% PROBModel size=6.9b2026.01 | 52 | |
| BT attackModel size=1.4b2026.01 | 52 | |
| RECALLModel size=1.4b2026.01 | 52 | |
| RECALLModel size=6.9b2026.01 | 52 | |
| reference attackModel size=1.4b2026.01 | 51 | |
| reference attackModel size=2.8b2026.01 | 51 | |
| zlib attackModel size=1.4b2026.01 | 51 | |
| neighborhood attackModel size=6.9b2026.01 | 51 | |
| neighborhood attackModel size=1.4b2026.01 | 50 | |
| neighborhood attackModel size=2.8b2026.01 | 50 | |
| WS attackModel size=1.4b2026.01 | 50 | |
| WS attackModel size=6.9b2026.01 | 50 | |
| RS attackModel size=1.4b2026.01 | 50 | |
| BT attackModel size=2.8b2026.01 | 50 | |
| BT attackModel size=6.9b2026.01 | 50 | |
| RECALLModel size=2.8b2026.01 | 50 | |
| WS attackModel size=2.8b2026.01 | 49 | |
| RS attackModel size=6.9b2026.01 | 49 | |
| RS attackModel size=2.8b2026.01 | 48 |