Membership Inference on Average Pythia (train)
51.4TPR@1%FPRAttenMIA (Perturbed)
Evaluation results
| Method | Links | |
|---|---|---|
| AttenMIA (Perturbed)Model Size=6.9b2026.01 | 51.4 | |
| AttenMIA (Perturbed)Model Size=2.8b2026.01 | 50.4 | |
| AttenMIA (Perturbed)Model Size=1.4b2026.01 | 41.6 | |
| AttenMIA (Transitional)Model Size=1.4b2026.01 | 34.1 | |
| AttenMIA (Transitional)Model Size=2.8b2026.01 | 33.4 | |
| AttenMIA (Transitional)Model Size=6.9b2026.01 | 31.9 | |
| PPL attackModel Size=6.9b2026.01 | 16.9 | |
| PPL attackModel Size=1.4b2026.01 | 16.6 | |
| PPL attackModel Size=2.8b2026.01 | 14.9 |