Membership Inference Attack on News (TPR vs FPR evaluation)
18.9TPR @ 1% FPRLikelihood Ratio Attack (Oracle Reference Model*)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Likelihood Ratio Attack (Oracle Reference Model*)Attack Category=Likelihood Ratio Attack, Reference Source=Oracle2023.05 | 18.9 | 3.76 | 0.16 | |
| Neighbour AttackAttack Category=Reference-Free Attack2023.05 | 8.29 | 1.73 | 0.29 | |
| Likelihood Ratio Attack (Candidate Reference Model 1)Attack Category=Likelihood Ratio Attack, Reference Source=Other AG News categories2023.05 | 4.91 | 0.95 | 0.15 | |
| Likelihood Ratio Attack (Candidate Reference Model 2)Attack Category=Likelihood Ratio Attack, Reference Source=NewsCatcher2023.05 | 4.76 | 0.92 | 0.15 | |
| Likelihood Ratio Attack (Base Reference Model)Attack Category=Likelihood Ratio Attack, Reference Source=Base Reference Model2023.05 | 4.24 | 0.91 | 0.16 | |
| LOSS AttackAttack Category=Reference-Free Attack2023.05 | 3.5 | 0.1 | 0.01 |