Membership Inference Attack on OPT-6.7B
12.8TPR @ 1% FPRCAMIA
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| CAMIABase Attack=CAMIA, Augmentation=None, Iterations=152026.06 | 12.8 | 0.664 | |
| Zlib + CombinedBase Attack=Zlib, Augmentation=Combined, Iterations=152026.06 | 12.1 | 0.672 | |
| CAMIA + QualityBase Attack=CAMIA, Augmentation=Quality, Iterations=152026.06 | 11.5 | 0.682 | |
| Loss + CombinedBase Attack=Loss, Augmentation=Combined, Iterations=152026.06 | 11.2 | 0.672 | |
| CAMIA + CombinedBase Attack=CAMIA, Augmentation=Combined, Iterations=152026.06 | 10.9 | 0.689 | |
| CAMIA + DiversityBase Attack=CAMIA, Augmentation=Diversity, Iterations=152026.06 | 10.4 | 0.668 | |
| Zlib + DiversityBase Attack=Zlib, Augmentation=Diversity, Iterations=152026.06 | 9.9 | 0.628 | |
| Min-K% + QualityBase Attack=Min-K%, Augmentation=Quality, Iterations=152026.06 | 9.4 | 0.674 | |
| Loss + DiversityBase Attack=Loss, Augmentation=Diversity, Iterations=152026.06 | 9.2 | 0.613 | |
| Zlib + QualityBase Attack=Zlib, Augmentation=Quality, Iterations=152026.06 | 9.2 | 0.667 | |
| Min-K% + CombinedBase Attack=Min-K%, Augmentation=Combined, Iterations=152026.06 | 9.2 | 0.694 | |
| Min-K%Base Attack=Min-K%, Augmentation=None, Iterations=152026.06 | 8.6 | 0.65 | |
| Loss + QualityBase Attack=Loss, Augmentation=Quality, Iterations=152026.06 | 8.4 | 0.652 | |
| Min-K% + DiversityBase Attack=Min-K%, Augmentation=Diversity, Iterations=152026.06 | 6.4 | 0.64 | |
| LossBase Attack=Loss, Augmentation=None, Iterations=152026.06 | 1.3 | 0.39 | |
| ZlibBase Attack=Zlib, Augmentation=None, Iterations=152026.06 | 1.2 | 0.369 |