Membership Inference Attack on OpenForensics
70TPR @ 0.1% FPRLIME
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LIMEDefense=Memguard, Backbone=MobileNetV22026.07 | 70 | 70 | |
| LIMEDefense=None, Backbone=MobileNetV22026.07 | 69 | 70 | |
| SHAPDefense=Memguard, Backbone=MobileNetV22026.07 | 35 | 68 | |
| SHAPDefense=None, Backbone=MobileNetV22026.07 | 30 | 69 | |
| SmoothGradDefense=TIER, Backbone=MobileNetV22026.07 | 30 | 54 | |
| SmoothGradDefense=DP (ϵ = 100), Backbone=MobileNetV22026.07 | 20 | 55 | |
| LIMEDefense=DP (ϵ = 100), Backbone=MobileNetV22026.07 | 20 | 55 | |
| GradCAM++Defense=Memguard, Backbone=MobileNetV22026.07 | 15 | 68 | |
| SmoothGradDefense=None, Backbone=MobileNetV22026.07 | 10 | 70 | |
| GradCAMDefense=None, Backbone=MobileNetV22026.07 | 10 | 68 | |
| GradCAM++Defense=None, Backbone=MobileNetV22026.07 | 10 | 69 | |
| VarGradDefense=DP (ϵ = 100), Backbone=MobileNetV22026.07 | 10 | 54 | |
| GradCAMDefense=DP (ϵ = 100), Backbone=MobileNetV22026.07 | 10 | 53 | |
| GradCAM++Defense=DP (ϵ = 100), Backbone=MobileNetV22026.07 | 10 | 55 | |
| IGDefense=DP (ϵ = 100), Backbone=MobileNetV22026.07 | 10 | 52 | |
| SmoothGradDefense=Memguard, Backbone=MobileNetV22026.07 | 10 | 70 | |
| GradCAMDefense=Memguard, Backbone=MobileNetV22026.07 | 10 | 70 | |
| GradCAM++Defense=TIER, Backbone=MobileNetV22026.07 | 10 | 53 | |
| IGDefense=TIER, Backbone=MobileNetV22026.07 | 10 | 54 | |
| VarGradDefense=None, Backbone=MobileNetV22026.07 | 0 | 70 | |
| IGDefense=None, Backbone=MobileNetV22026.07 | 0 | 69 | |
| SHAPDefense=DP (ϵ = 100), Backbone=MobileNetV22026.07 | 0 | 54 | |
| VarGradDefense=Memguard, Backbone=MobileNetV22026.07 | 0 | 69 | |
| IGDefense=Memguard, Backbone=MobileNetV22026.07 | 0 | 70 | |
| VarGradDefense=TIER, Backbone=MobileNetV22026.07 | 0 | 54 | |
| GradCAMDefense=TIER, Backbone=MobileNetV22026.07 | 0 | 55 | |
| SHAPDefense=TIER, Backbone=MobileNetV22026.07 | 0 | 54 | |
| LIMEDefense=TIER, Backbone=MobileNetV22026.07 | 0 | 53 |