Membership Inference Attack on CIFAR10 (Balanced Accuracy and TPR@0.1%FPR)
70TPR @ 0.1% FPRLIME
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LIMEDefense=None, Backbone=ResNet-182026.07 | 70 | 66 | |
| LIMEDefense=Memguard, Backbone=ResNet-182026.07 | 60 | 67 | |
| IGDefense=Memguard, Backbone=ResNet-182026.07 | 40 | 62 | |
| GradCAMDefense=Memguard, Backbone=ResNet-182026.07 | 30 | 62 | |
| VarGradDefense=None, Backbone=ResNet-182026.07 | 20 | 65 | |
| GradCAM++Defense=None, Backbone=ResNet-182026.07 | 20 | 64 | |
| SHAPDefense=None, Backbone=ResNet-182026.07 | 20 | 62 | |
| VarGradDefense=DP (ϵ = 100), Backbone=ResNet-182026.07 | 20 | 50 | |
| VarGradDefense=Memguard, Backbone=ResNet-182026.07 | 20 | 65 | |
| GradCAM++Defense=Memguard, Backbone=ResNet-182026.07 | 20 | 64 | |
| SmoothGradDefense=None, Backbone=ResNet-182026.07 | 10 | 63 | |
| GradCAMDefense=None, Backbone=ResNet-182026.07 | 10 | 63 | |
| IGDefense=None, Backbone=ResNet-182026.07 | 10 | 63 | |
| GradCAMDefense=DP (ϵ = 100), Backbone=ResNet-182026.07 | 10 | 51 | |
| LIMEDefense=DP (ϵ = 100), Backbone=ResNet-182026.07 | 10 | 51 | |
| SmoothGradDefense=Memguard, Backbone=ResNet-182026.07 | 10 | 60 | |
| SHAPDefense=Memguard, Backbone=ResNet-182026.07 | 10 | 61 | |
| SmoothGradDefense=TIER, Backbone=ResNet-182026.07 | 10 | 53 | |
| VarGradDefense=TIER, Backbone=ResNet-182026.07 | 10 | 55 | |
| GradCAM++Defense=TIER, Backbone=ResNet-182026.07 | 10 | 53 | |
| IGDefense=TIER, Backbone=ResNet-182026.07 | 10 | 54 | |
| SHAPDefense=TIER, Backbone=ResNet-182026.07 | 10 | 53 | |
| LIMEDefense=TIER, Backbone=ResNet-182026.07 | 10 | 56 | |
| SmoothGradDefense=DP (ϵ = 100), Backbone=ResNet-182026.07 | 0 | 50 | |
| GradCAM++Defense=DP (ϵ = 100), Backbone=ResNet-182026.07 | 0 | 52 | |
| IGDefense=DP (ϵ = 100), Backbone=ResNet-182026.07 | 0 | 49 | |
| SHAPDefense=DP (ϵ = 100), Backbone=ResNet-182026.07 | 0 | 50 | |
| GradCAMDefense=TIER, Backbone=ResNet-182026.07 | 0 | 54 |