Membership Inference Attack on GTSRB (TPR @ 0.1% FPR, Balanced Accuracy)
37.06TPR @ 0.1% FPRLIME
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LIMEDefense=None, Backbone=ResNet-182026.07 | 37.06 | 80 | |
| IGDefense=None, Backbone=ResNet-182026.07 | 36.1 | 83 | |
| IGDefense=Memguard, Backbone=ResNet-182026.07 | 33.23 | 77 | |
| LIMEDefense=Memguard, Backbone=ResNet-182026.07 | 30.12 | 81 | |
| SHAPDefense=None, Backbone=ResNet-182026.07 | 29.71 | 82 | |
| VarGradDefense=None, Backbone=ResNet-182026.07 | 29.39 | 78 | |
| GradCAM++Defense=None, Backbone=ResNet-182026.07 | 28.75 | 79 | |
| GradCAM++Defense=Memguard, Backbone=ResNet-182026.07 | 26.5 | 79 | |
| SHAPDefense=Memguard, Backbone=ResNet-182026.07 | 23.32 | 79 | |
| VarGradDefense=Memguard, Backbone=ResNet-182026.07 | 23.3 | 76 | |
| SmoothGradDefense=None, Backbone=ResNet-182026.07 | 20.13 | 84 | |
| SmoothGradDefense=Memguard, Backbone=ResNet-182026.07 | 19.8 | 80 | |
| GradCAMDefense=Memguard, Backbone=ResNet-182026.07 | 12.7 | 77 | |
| GradCAMDefense=None, Backbone=ResNet-182026.07 | 12.46 | 80 | |
| SmoothGradDefense=TIER, Backbone=ResNet-182026.07 | 0.15 | 54 | |
| GradCAM++Defense=TIER, Backbone=ResNet-182026.07 | 0.1 | 52 | |
| IGDefense=TIER, Backbone=ResNet-182026.07 | 0.1 | 52 | |
| LIMEDefense=DP (ϵ = 100), Backbone=ResNet-182026.07 | 0.01 | 54 | |
| SmoothGradDefense=DP (ϵ = 100), Backbone=ResNet-182026.07 | 0 | 51 | |
| VarGradDefense=DP (ϵ = 100), Backbone=ResNet-182026.07 | 0 | 50 | |
| GradCAMDefense=DP (ϵ = 100), Backbone=ResNet-182026.07 | 0 | 51 | |
| GradCAM++Defense=DP (ϵ = 100), Backbone=ResNet-182026.07 | 0 | 52 | |
| IGDefense=DP (ϵ = 100), Backbone=ResNet-182026.07 | 0 | 53 | |
| SHAPDefense=DP (ϵ = 100), Backbone=ResNet-182026.07 | 0 | 53 | |
| VarGradDefense=TIER, Backbone=ResNet-182026.07 | 0 | 53 | |
| GradCAMDefense=TIER, Backbone=ResNet-182026.07 | 0 | 52 | |
| SHAPDefense=TIER, Backbone=ResNet-182026.07 | 0 | 52 | |
| LIMEDefense=TIER, Backbone=ResNet-182026.07 | 0 | 52 |