Membership Inference Attack on Pythia 6.9B
13.1TPR@1%FPRCAMIA + Quality
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CAMIA + QualityBase Attack=CAMIA, Augmentation=Quality, Iterations=152026.06 | 13.1 | 70.8 | |
| Zlib + DiversityBase Attack=Zlib, Augmentation=Diversity, Iterations=152026.06 | 12.9 | 67.7 | |
| Zlib + CombinedBase Attack=Zlib, Augmentation=Combined, Iterations=152026.06 | 12.8 | 69 | |
| Zlib + QualityBase Attack=Zlib, Augmentation=Quality, Iterations=152026.06 | 12.4 | 67.3 | |
| Min-K%Base Attack=Min-K%, Augmentation=None, Iterations=152026.06 | 12.4 | 68 | |
| Min-K% + QualityBase Attack=Min-K%, Augmentation=Quality, Iterations=152026.06 | 12.4 | 69.5 | |
| Min-K% + DiversityBase Attack=Min-K%, Augmentation=Diversity, Iterations=152026.06 | 12 | 67.7 | |
| CAMIA + DiversityBase Attack=CAMIA, Augmentation=Diversity, Iterations=152026.06 | 11.8 | 69 | |
| Min-K% + CombinedBase Attack=Min-K%, Augmentation=Combined, Iterations=152026.06 | 11.3 | 69.4 | |
| CAMIABase Attack=CAMIA, Augmentation=None, Iterations=152026.06 | 11.1 | 68.3 | |
| CAMIA + CombinedBase Attack=CAMIA, Augmentation=Combined, Iterations=152026.06 | 10.9 | 69.6 | |
| Loss + CombinedBase Attack=Loss, Augmentation=Combined, Iterations=152026.06 | 10 | 67.3 | |
| Loss + QualityBase Attack=Loss, Augmentation=Quality, Iterations=152026.06 | 9.6 | 68.6 | |
| Loss + DiversityBase Attack=Loss, Augmentation=Diversity, Iterations=152026.06 | 9.3 | 64.7 | |
| LossBase Attack=Loss, Augmentation=None, Iterations=152026.06 | 0.4 | 34.9 | |
| ZlibBase Attack=Zlib, Augmentation=None, Iterations=152026.06 | 0 | 33.8 |