# Explanation Hardening Evaluation on CIFAR-100 (8% utility loss, ϵ=10, δ=10⁻⁵, test) Source: [Explanation Hardening Evaluation on CIFAR-100 (8% utility loss, ϵ=10, δ=10⁻⁵, test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:49:55.998Z Evaluation of model explanation hardening techniques applied to CIFAR-100, specifically under conditions of 8% utility loss and defined privacy parameters (epsilon=10, delta=10^-5). Metrics focus on Membership Inference Success Rate (MLS) changes. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Explanation Hardening Evaluation | | Dataset (including any stated split) | CIFAR-100 8% utility loss, ϵ = 10, δ = 10⁻⁵ (test) | | Metric | MLS (TPR@0.1% FPR) Pre-Hardening | | Unit | PERCENT | | Direction | Lower is better | | Results loaded | 30 of 30 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [MLS (TPR@0.1% FPR) Pre-Hardening](): Lower is better; unit: PERCENT. - [MLS (TPR@0.1% FPR) Post-Hardening](): Lower is better; unit: SCALAR. - [Sensitivity Change (∆S)](): Lower is better; unit: PERCENT. ## Recorded results | Method | MLS (TPR@0.1% FPR) Pre-Hardening | Result date | Report paper | | --- | --- | --- | --- | | Occlusion | 0.64 | Not recorded | 695f39e353fdd5c361743ce1 | | Occlusion | 0.64 | Not recorded | 695f39e353fdd5c361743ce1 | | VarGrad | 6.68 | Not recorded | 695f39e353fdd5c361743ce1 | | VarGrad | 6.68 | Not recorded | 695f39e353fdd5c361743ce1 | | GradCAM | 6.78 | Not recorded | 695f39e353fdd5c361743ce1 | | GradCAM | 6.78 | Not recorded | 695f39e353fdd5c361743ce1 | | LIME | 10.26 | Not recorded | 695f39e353fdd5c361743ce1 | | LIME | 10.26 | Not recorded | 695f39e353fdd5c361743ce1 | | SmoothGrad | 10.38 | Not recorded | 695f39e353fdd5c361743ce1 | | SmoothGrad | 10.38 | Not recorded | 695f39e353fdd5c361743ce1 | | SHAP | 11.8 | Not recorded | 695f39e353fdd5c361743ce1 | | SHAP | 11.8 | Not recorded | 695f39e353fdd5c361743ce1 | | DeepLIFT | 11.82 | Not recorded | 695f39e353fdd5c361743ce1 | | DeepLIFT | 11.82 | Not recorded | 695f39e353fdd5c361743ce1 | | ProtoDash | 14.9 | Not recorded | 695f39e353fdd5c361743ce1 | | ProtoDash | 14.9 | Not recorded | 695f39e353fdd5c361743ce1 | | Integrated Gradients | 16.42 | Not recorded | 695f39e353fdd5c361743ce1 | | Integrated Gradients | 16.42 | Not recorded | 695f39e353fdd5c361743ce1 | | GradCAM++ | 18 | Not recorded | 695f39e353fdd5c361743ce1 | | GradCAM++ | 18 | Not recorded | 695f39e353fdd5c361743ce1 | | Saliency Map | 18.84 | Not recorded | 695f39e353fdd5c361743ce1 | | Saliency Map | 18.84 | Not recorded | 695f39e353fdd5c361743ce1 | | InputXGrad | 24.68 | Not recorded | 695f39e353fdd5c361743ce1 | | InputXGrad | 24.68 | Not recorded | 695f39e353fdd5c361743ce1 | | Anchors | 43.32 | Not recorded | 695f39e353fdd5c361743ce1 | | Anchors | 43.32 | Not recorded | 695f39e353fdd5c361743ce1 | | Guided BackProp | 45.32 | Not recorded | 695f39e353fdd5c361743ce1 | | Guided BackProp | 45.32 | Not recorded | 695f39e353fdd5c361743ce1 | | Deconvolution | 48.48 | Not recorded | 695f39e353fdd5c361743ce1 | | Deconvolution | 48.48 | Not recorded | 695f39e353fdd5c361743ce1 | ### Occlusion MLS (TPR@0.1% FPR) Pre-Hardening: 0.64. Result ID: 6996f5205698665ec441cd38. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### Occlusion MLS (TPR@0.1% FPR) Pre-Hardening: 0.64. Result ID: 6996f5205698665ec441cd39. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### VarGrad MLS (TPR@0.1% FPR) Pre-Hardening: 6.68. Result ID: 6996f5205698665ec441cd22. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### VarGrad MLS (TPR@0.1% FPR) Pre-Hardening: 6.68. Result ID: 6996f5205698665ec441cd23. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### GradCAM MLS (TPR@0.1% FPR) Pre-Hardening: 6.78. Result ID: 6996f5205698665ec441cd26. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### GradCAM MLS (TPR@0.1% FPR) Pre-Hardening: 6.78. Result ID: 6996f5205698665ec441cd27. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### LIME MLS (TPR@0.1% FPR) Pre-Hardening: 10.26. Result ID: 6996f5205698665ec441cd2c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### LIME MLS (TPR@0.1% FPR) Pre-Hardening: 10.26. Result ID: 6996f5205698665ec441cd2d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### SmoothGrad MLS (TPR@0.1% FPR) Pre-Hardening: 10.38. Result ID: 6996f5205698665ec441cd20. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### SmoothGrad MLS (TPR@0.1% FPR) Pre-Hardening: 10.38. Result ID: 6996f5205698665ec441cd21. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### SHAP MLS (TPR@0.1% FPR) Pre-Hardening: 11.8. Result ID: 6996f5205698665ec441cd2a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### SHAP MLS (TPR@0.1% FPR) Pre-Hardening: 11.8. Result ID: 6996f5205698665ec441cd2b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### DeepLIFT MLS (TPR@0.1% FPR) Pre-Hardening: 11.82. Result ID: 6996f5205698665ec441cd32. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### DeepLIFT MLS (TPR@0.1% FPR) Pre-Hardening: 11.82. Result ID: 6996f5205698665ec441cd33. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### ProtoDash MLS (TPR@0.1% FPR) Pre-Hardening: 14.9. Result ID: 6996f5205698665ec441cd3a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### ProtoDash MLS (TPR@0.1% FPR) Pre-Hardening: 14.9. Result ID: 6996f5205698665ec441cd3b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### Integrated Gradients MLS (TPR@0.1% FPR) Pre-Hardening: 16.42. Result ID: 6996f5205698665ec441cd24. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### Integrated Gradients MLS (TPR@0.1% FPR) Pre-Hardening: 16.42. Result ID: 6996f5205698665ec441cd25. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### GradCAM++ MLS (TPR@0.1% FPR) Pre-Hardening: 18. Result ID: 6996f5205698665ec441cd28. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### GradCAM++ MLS (TPR@0.1% FPR) Pre-Hardening: 18. Result ID: 6996f5205698665ec441cd29. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### Saliency Map MLS (TPR@0.1% FPR) Pre-Hardening: 18.84. Result ID: 6996f5205698665ec441cd2e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### Saliency Map MLS (TPR@0.1% FPR) Pre-Hardening: 18.84. Result ID: 6996f5205698665ec441cd2f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### InputXGrad MLS (TPR@0.1% FPR) Pre-Hardening: 24.68. Result ID: 6996f5205698665ec441cd34. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### InputXGrad MLS (TPR@0.1% FPR) Pre-Hardening: 24.68. Result ID: 6996f5205698665ec441cd35. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### Anchors MLS (TPR@0.1% FPR) Pre-Hardening: 43.32. Result ID: 6996f5205698665ec441cd3c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### Anchors MLS (TPR@0.1% FPR) Pre-Hardening: 43.32. Result ID: 6996f5205698665ec441cd3d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### Guided BackProp MLS (TPR@0.1% FPR) Pre-Hardening: 45.32. Result ID: 6996f5205698665ec441cd30. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### Guided BackProp MLS (TPR@0.1% FPR) Pre-Hardening: 45.32. Result ID: 6996f5205698665ec441cd31. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### Deconvolution MLS (TPR@0.1% FPR) Pre-Hardening: 48.48. Result ID: 6996f5205698665ec441cd36. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### Deconvolution MLS (TPR@0.1% FPR) Pre-Hardening: 48.48. Result ID: 6996f5205698665ec441cd37. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.