Membership Inference Attack on Language Modeling PII-annotated (train)
21.5TPR @ 0.1% FPRmlmA-bert
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| mlmA-bertBackbone=RoBERTa LARGE2025.01 | 21.5 | 26.63 | 45.54 | |
| mlmA-bertBackbone=BERT2025.01 | 8.87 | 15.28 | 37 | |
| mlmA-bertBackbone=DISTIL RoBERTa2025.01 | 4.59 | 8.25 | 31.35 | |
| mlm-bertBackbone=DISTIL RoBERTa2025.01 | 2.69 | 13.3 | 32.81 | |
| PPmlm-bertBackbone=DISTIL RoBERTa2025.01 | 2.46 | 3.08 | 13.46 | |
| PPmlm-bertBackbone=BERT2025.01 | 1.25 | 1.74 | 9.95 | |
| mlm-bertBackbone=BERT2025.01 | 1.22 | 10.91 | 36.62 | |
| mlm-bertBackbone=RoBERTa LARGE2025.01 | 0.6 | 31.09 | 49.34 | |
| PPmlm-bertBackbone=RoBERTa LARGE2025.01 | 0.58 | 2.3 | 12.24 |