Membership Inference Attack on arXiv Pythia
94ROC AUCAttenMIA (Perturbed)
Evaluation results
| Method | Links | |
|---|---|---|
| AttenMIA (Perturbed)Model size=2.8b2026.01 | 94 | |
| AttenMIA (Perturbed)Model size=6.9b2026.01 | 94 | |
| AttenMIA (Perturbed)Model size=1.4b2026.01 | 93 | |
| AttenMIA (Transitional)Model size=1.4b2026.01 | 81 | |
| AttenMIA (Transitional)Model size=2.8b2026.01 | 79 | |
| AttenMIA (Transitional)Model size=6.9b2026.01 | 78 | |
| neighborhood attackModel size=1.4b2026.01 | 69 | |
| neighborhood attackModel size=2.8b2026.01 | 69 | |
| neighborhood attackModel size=6.9b2026.01 | 69 | |
| reference attackModel size=1.4b2026.01 | 67 | |
| reference attackModel size=6.9b2026.01 | 67 | |
| PPL attackModel size=1.4b2026.01 | 66 | |
| PPL attackModel size=6.9b2026.01 | 66 | |
| zlib attackModel size=6.9b2026.01 | 66 | |
| zlib attackModel size=1.4b2026.01 | 65 | |
| PPL attackModel size=2.8b2026.01 | 64 | |
| reference attackModel size=2.8b2026.01 | 64 | |
| zlib attackModel size=2.8b2026.01 | 64 | |
| MIN-K% PROBModel size=1.4b2026.01 | 62 | |
| MIN-K% PROBModel size=6.9b2026.01 | 62 | |
| MIN-K% PROBModel size=2.8b2026.01 | 61 | |
| PETALModel size=1.4b2026.01 | 58 | |
| PETALModel size=6.9b2026.01 | 58 | |
| PETALModel size=2.8b2026.01 | 57 | |
| BT attackModel size=6.9b2026.01 | 55 | |
| RECALLModel size=6.9b2026.01 | 55 | |
| RECALLModel size=1.4b2026.01 | 53 | |
| RECALLModel size=2.8b2026.01 | 53 | |
| RS attackModel size=6.9b2026.01 | 51 | |
| BT attackModel size=1.4b2026.01 | 51 | |
| BT attackModel size=2.8b2026.01 | 51 | |
| WS attackModel size=1.4b2026.01 | 50 | |
| WS attackModel size=2.8b2026.01 | 50 | |
| WS attackModel size=6.9b2026.01 | 50 | |
| RS attackModel size=1.4b2026.01 | 50 | |
| RS attackModel size=2.8b2026.01 | 48 |