Membership Inference on HackerNews Pythia (train)
18.9TPR@1%FPRAttenMIA (Perturbed)
Evaluation Results
| Method | Links | |
|---|---|---|
| AttenMIA (Perturbed)Model Size=6.9b2026.01 | 18.9 | |
| AttenMIA (Perturbed)Model Size=1.4b2026.01 | 13.8 | |
| AttenMIA (Perturbed)Model Size=2.8b2026.01 | 13 | |
| AttenMIA (Transitional)Model Size=1.4b2026.01 | 7.4 | |
| PPL attackModel Size=2.8b2026.01 | 6 | |
| PPL attackModel Size=6.9b2026.01 | 5.6 | |
| AttenMIA (Transitional)Model Size=6.9b2026.01 | 5.1 | |
| PPL attackModel Size=1.4b2026.01 | 4.8 | |
| AttenMIA (Transitional)Model Size=2.8b2026.01 | 4.8 |