Membership Inference Attack on CINIC-10 (TPR @ 0.1% FPR, Balanced Accuracy)
1.5TPR @ 0.1% FPRLIME
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LIMEDefense=Memguard, Backbone=ResNet-182026.07 | 1.5 | 72 | |
| LIMEDefense=None, Backbone=ResNet-182026.07 | 1.4 | 74 | |
| VarGradDefense=Memguard, Backbone=ResNet-182026.07 | 0.9 | 72 | |
| VarGradDefense=None, Backbone=ResNet-182026.07 | 0.89 | 73 | |
| GradCAMDefense=None, Backbone=ResNet-182026.07 | 0.8 | 71 | |
| GradCAMDefense=Memguard, Backbone=ResNet-182026.07 | 0.8 | 70 | |
| SmoothGradDefense=Memguard, Backbone=ResNet-182026.07 | 0.5 | 73 | |
| SmoothGradDefense=None, Backbone=ResNet-182026.07 | 0.45 | 73 | |
| VarGradDefense=DP (ϵ = 100), Backbone=ResNet-182026.07 | 0.35 | 50 | |
| SHAPDefense=Memguard, Backbone=ResNet-182026.07 | 0.35 | 73 | |
| LIMEDefense=TIER, Backbone=ResNet-182026.07 | 0.35 | 56 | |
| SHAPDefense=None, Backbone=ResNet-182026.07 | 0.3 | 73 | |
| GradCAM++Defense=Memguard, Backbone=ResNet-182026.07 | 0.3 | 72 | |
| SHAPDefense=TIER, Backbone=ResNet-182026.07 | 0.3 | 54 | |
| GradCAM++Defense=None, Backbone=ResNet-182026.07 | 0.2 | 72 | |
| SmoothGradDefense=DP (ϵ = 100), Backbone=ResNet-182026.07 | 0.15 | 49 | |
| IGDefense=DP (ϵ = 100), Backbone=ResNet-182026.07 | 0.15 | 50 | |
| SHAPDefense=DP (ϵ = 100), Backbone=ResNet-182026.07 | 0.15 | 50 | |
| IGDefense=None, Backbone=ResNet-182026.07 | 0.1 | 73 | |
| GradCAMDefense=DP (ϵ = 100), Backbone=ResNet-182026.07 | 0.1 | 50 | |
| GradCAM++Defense=DP (ϵ = 100), Backbone=ResNet-182026.07 | 0.1 | 50 | |
| LIMEDefense=DP (ϵ = 100), Backbone=ResNet-182026.07 | 0.1 | 52 | |
| IGDefense=Memguard, Backbone=ResNet-182026.07 | 0.05 | 71 | |
| SmoothGradDefense=TIER, Backbone=ResNet-182026.07 | 0.05 | 55 | |
| GradCAM++Defense=TIER, Backbone=ResNet-182026.07 | 0.05 | 55 | |
| VarGradDefense=TIER, Backbone=ResNet-182026.07 | 0 | 56 | |
| GradCAMDefense=TIER, Backbone=ResNet-182026.07 | 0 | 55 | |
| IGDefense=TIER, Backbone=ResNet-182026.07 | 0 | 53 |