Membership Inference Attack on ImageNet RAR Generated 1.0 (test)
99.9TPR@1%FPR (NM/GM)RMIA
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| RMIAModel=RAR, Number of shadow models=52026.06 | 99.9 | 65.7 | 99.5 | 100 | 96.2 | 100 | 99 | 77.5 | 71.3 | 17.8 | 82.7 | |
| Data Circuit BreakerModel=RAR, Number of shadow models=52026.06 | 99.9 | 99.9 | 99.9 | 99.9 | 99.9 | 99.9 | 100 | 100 | 95.6 | 72.5 | 96.7 | |
| LiRAModel=RAR, Number of shadow models=52026.06 | 92.8 | 0.8 | 31.2 | 95 | 1.2 | 36.9 | 94.2 | 18.4 | 34.4 | 1.3 | 40.6 |