Membership Inference Attack on GTSRB (test)
43.52TPR@0.1%FPRDeepLeak
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DeepLeakExplanation Method=IG2026.01 | 43.52 | 0.968 | 0.995 | |
| DeepLeakExplanation Method=IG2026.01 | 43.52 | 0.968 | 0.995 | |
| DeepLeakExplanation Method=SHAP2026.01 | 28.83 | 0.981 | 0.962 | |
| DeepLeakExplanation Method=SHAP2026.01 | 28.83 | 0.981 | 0.962 | |
| DeepLeakExplanation Method=LIME2026.01 | 21.52 | 0.935 | 0.947 | |
| DeepLeakExplanation Method=LIME2026.01 | 21.52 | 0.935 | 0.947 | |
| DeepLeakExplanation Method=SmoothGrad2026.01 | 6.3 | 0.631 | 0.751 | |
| DeepLeakExplanation Method=SmoothGrad2026.01 | 6.3 | 0.631 | 0.751 | |
| DeepLeakExplanation Method=GradCAM++2026.01 | 5.78 | 0.729 | 0.795 | |
| DeepLeakExplanation Method=GradCAM++2026.01 | 5.78 | 0.729 | 0.795 | |
| DeepLeakExplanation Method=VarGrad2026.01 | 3.5 | 0.619 | 0.726 | |
| DeepLeakExplanation Method=VarGrad2026.01 | 3.5 | 0.619 | 0.726 | |
| Liu et al. w/ loss traj.Explanation Method=SmoothGrad2026.01 | 2.1 | 0.619 | 0.708 | |
| Liu et al. [18] w/ loss traj.Explanation Method=SmoothGrad2026.01 | 2.1 | 0.619 | 0.708 | |
| Liu et al. w/ loss traj.Explanation Method=GradCAM2026.01 | 1.9 | 0.616 | 0.74 | |
| Liu et al. w/ loss traj.Explanation Method=GradCAM++2026.01 | 1.9 | 0.616 | 0.707 | |
| Liu et al. [18] w/ loss traj.Explanation Method=GradCAM2026.01 | 1.9 | 0.616 | 0.74 | |
| Liu et al. [18] w/ loss traj.Explanation Method=GradCAM++2026.01 | 1.9 | 0.616 | 0.707 | |
| Liu et al. w/ loss traj.Explanation Method=IG2026.01 | 1.7 | 0.611 | 0.701 | |
| Liu et al. [18] w/ loss traj.Explanation Method=IG2026.01 | 1.7 | 0.611 | 0.701 | |
| Liu et al. w/ loss traj.Explanation Method=VarGrad2026.01 | 1.5 | 0.617 | 0.704 | |
| Liu et al. [18] w/ loss traj.Explanation Method=VarGrad2026.01 | 1.5 | 0.617 | 0.704 | |
| Liu et al. w/ loss traj.Explanation Method=SHAP2026.01 | 1.3 | 0.624 | 0.708 | |
| Liu et al. w/ loss traj.Explanation Method=LIME2026.01 | 1.3 | 0.622 | 0.703 | |
| Liu et al. [18] w/ loss traj.Explanation Method=SHAP2026.01 | 1.3 | 0.624 | 0.708 | |
| Liu et al. [18] w/ loss traj.Explanation Method=LIME2026.01 | 1.3 | 0.622 | 0.703 | |
| DeepLeakExplanation Method=GradCAM2026.01 | 0.74 | 0.663 | 0.613 | |
| DeepLeakExplanation Method=GradCAM2026.01 | 0.74 | 0.663 | 0.613 | |
| Shokri et al. (expl.)Explanation Method=SmoothGrad2026.01 | 0.3 | 0.5 | 0.679 | |
| Shokri et al. (expl.)Explanation Method=GradCAM2026.01 | 0.3 | 0.578 | 0.642 | |
| Shokri et al. (expl.)Explanation Method=GradCAM++2026.01 | 0.3 | 0.623 | 0.613 | |
| Shokri et al. (expl.)Explanation Method=SmoothGrad2026.01 | 0.3 | 0.5 | 0.679 | |
| Shokri et al. (expl.)Explanation Method=GradCAM2026.01 | 0.3 | 0.578 | 0.642 | |
| Shokri et al. (expl.)Explanation Method=GradCAM++2026.01 | 0.3 | 0.623 | 0.613 | |
| Shokri et al. (expl.)Explanation Method=SHAP2026.01 | 0.2 | 0.616 | 0.638 | |
| Shokri et al. (expl.)Explanation Method=LIME2026.01 | 0.2 | 0.61 | 0.627 | |
| Shokri et al. (expl.)Explanation Method=SHAP2026.01 | 0.2 | 0.616 | 0.638 | |
| Shokri et al. (expl.)Explanation Method=LIME2026.01 | 0.2 | 0.61 | 0.627 | |
| Shokri et al. (expl.)Explanation Method=VarGrad2026.01 | 0.1 | 0.658 | 0.692 | |
| Shokri et al. (expl.)Explanation Method=IG2026.01 | 0.1 | 0.637 | 0.687 | |
| Shokri et al. (expl.)Explanation Method=VarGrad2026.01 | 0.1 | 0.658 | 0.692 | |
| Shokri et al. (expl.)Explanation Method=IG2026.01 | 0.1 | 0.637 | 0.687 |