Membership Inference Attack on Llama-13B
21TPR@1%FPRZlib + Quality
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Zlib + QualityBase Attack=Zlib, Augmentation=Quality, Iterations=152026.06 | 21 | 68.8 | |
| Loss + QualityBase Attack=Loss, Augmentation=Quality, Iterations=152026.06 | 19.8 | 67.9 | |
| Zlib + CombinedBase Attack=Zlib, Augmentation=Combined, Iterations=152026.06 | 19.4 | 69.3 | |
| CAMIA + QualityBase Attack=CAMIA, Augmentation=Quality, Iterations=152026.06 | 19.2 | 71.2 | |
| Loss + CombinedBase Attack=Loss, Augmentation=Combined, Iterations=152026.06 | 18.8 | 70.2 | |
| Min-K% + CombinedBase Attack=Min-K%, Augmentation=Combined, Iterations=152026.06 | 18.2 | 70 | |
| Min-K% + QualityBase Attack=Min-K%, Augmentation=Quality, Iterations=152026.06 | 17.8 | 68.6 | |
| Zlib + DiversityBase Attack=Zlib, Augmentation=Diversity, Iterations=152026.06 | 17.6 | 68.9 | |
| CAMIA + CombinedBase Attack=CAMIA, Augmentation=Combined, Iterations=152026.06 | 17.6 | 71.6 | |
| Loss + DiversityBase Attack=Loss, Augmentation=Diversity, Iterations=152026.06 | 17.3 | 69 | |
| CAMIABase Attack=CAMIA, Augmentation=None, Iterations=152026.06 | 16.6 | 68.6 | |
| CAMIA + DiversityBase Attack=CAMIA, Augmentation=Diversity, Iterations=152026.06 | 14.6 | 69.2 | |
| Min-K% + DiversityBase Attack=Min-K%, Augmentation=Diversity, Iterations=152026.06 | 14.4 | 68.5 | |
| Min-K%Base Attack=Min-K%, Augmentation=None, Iterations=152026.06 | 12.7 | 64.8 | |
| LossBase Attack=Loss, Augmentation=None, Iterations=152026.06 | 0.9 | 36.8 | |
| ZlibBase Attack=Zlib, Augmentation=None, Iterations=152026.06 | 0.9 | 33.7 |