# Explanation Hardening Evaluation on GTSRB 2.5% utility loss, ϵ = 9, δ = 10⁻⁵ (test) Source: [Explanation Hardening Evaluation on GTSRB 2.5% utility loss, ϵ = 9, δ = 10⁻⁵ (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:49:55.754Z Evaluation of model explanation hardening effectiveness on the GTSRB dataset, specifically testing against utility loss constraints of 2.5% (ϵ=9, δ=10⁻⁵). Metrics focus on Mean Logit Sensitivity (MLS) changes post-hardening. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Explanation Hardening Evaluation | | Dataset (including any stated split) | GTSRB 2.5% utility loss, ϵ = 9, δ = 10⁻⁵ (test) | | Metric | MLS (TPR@0.1% FPR) Pre | | Unit | SCALAR | | Direction | Lower is better | | Results loaded | 30 of 30 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [MLS (TPR@0.1% FPR) Pre](): Lower is better; unit: SCALAR. - [MLS (TPR@0.1% FPR) Post](): Lower is better; unit: SCALAR. - [MLS Sensitivity Reduction (%)](): Higher is better; unit: PERCENT. ## Recorded results | Method | MLS (TPR@0.1% FPR) Pre | Result date | Report paper | | --- | --- | --- | --- | | GradCAM | 0.39 | Not recorded | 695f39e353fdd5c361743ce1 | | GradCAM | 0.39 | Not recorded | 695f39e353fdd5c361743ce1 | | Occlusion | 0.53 | Not recorded | 695f39e353fdd5c361743ce1 | | Occlusion | 0.53 | Not recorded | 695f39e353fdd5c361743ce1 | | VarGrad | 3.52 | Not recorded | 695f39e353fdd5c361743ce1 | | VarGrad | 3.52 | Not recorded | 695f39e353fdd5c361743ce1 | | GradCAM++ | 3.72 | Not recorded | 695f39e353fdd5c361743ce1 | | GradCAM++ | 3.72 | Not recorded | 695f39e353fdd5c361743ce1 | | Saliency Map | 5.84 | Not recorded | 695f39e353fdd5c361743ce1 | | Saliency Map | 5.84 | Not recorded | 695f39e353fdd5c361743ce1 | | Deconvolution | 5.84 | Not recorded | 695f39e353fdd5c361743ce1 | | Deconvolution | 5.84 | Not recorded | 695f39e353fdd5c361743ce1 | | SmoothGrad | 6.31 | Not recorded | 695f39e353fdd5c361743ce1 | | SmoothGrad | 6.31 | Not recorded | 695f39e353fdd5c361743ce1 | | Guided BackProp | 6.64 | Not recorded | 695f39e353fdd5c361743ce1 | | Guided BackProp | 6.64 | Not recorded | 695f39e353fdd5c361743ce1 | | LIME | 21.52 | Not recorded | 695f39e353fdd5c361743ce1 | | LIME | 21.52 | Not recorded | 695f39e353fdd5c361743ce1 | | SHAP | 28.83 | Not recorded | 695f39e353fdd5c361743ce1 | | SHAP | 28.83 | Not recorded | 695f39e353fdd5c361743ce1 | | DeepLIFT | 37.61 | Not recorded | 695f39e353fdd5c361743ce1 | | DeepLIFT | 37.61 | Not recorded | 695f39e353fdd5c361743ce1 | | Integrated Gradients | 43.52 | Not recorded | 695f39e353fdd5c361743ce1 | | Integrated Gradients | 43.52 | Not recorded | 695f39e353fdd5c361743ce1 | | InputXGrad | 46.37 | Not recorded | 695f39e353fdd5c361743ce1 | | InputXGrad | 46.37 | Not recorded | 695f39e353fdd5c361743ce1 | | ProtoDash | 52.96 | Not recorded | 695f39e353fdd5c361743ce1 | | ProtoDash | 52.96 | Not recorded | 695f39e353fdd5c361743ce1 | | Anchors | 80.8 | Not recorded | 695f39e353fdd5c361743ce1 | | Anchors | 80.8 | Not recorded | 695f39e353fdd5c361743ce1 | ### GradCAM MLS (TPR@0.1% FPR) Pre: 0.39. Result ID: 6996f5205698665ec441cd44. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### GradCAM MLS (TPR@0.1% FPR) Pre: 0.39. Result ID: 6996f5205698665ec441cd45. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### Occlusion MLS (TPR@0.1% FPR) Pre: 0.53. Result ID: 6996f5205698665ec441cd56. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### Occlusion MLS (TPR@0.1% FPR) Pre: 0.53. Result ID: 6996f5205698665ec441cd57. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### VarGrad MLS (TPR@0.1% FPR) Pre: 3.52. Result ID: 6996f5205698665ec441cd40. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### VarGrad MLS (TPR@0.1% FPR) Pre: 3.52. Result ID: 6996f5205698665ec441cd41. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### GradCAM++ MLS (TPR@0.1% FPR) Pre: 3.72. Result ID: 6996f5205698665ec441cd46. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### GradCAM++ MLS (TPR@0.1% FPR) Pre: 3.72. Result ID: 6996f5205698665ec441cd47. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### Saliency Map MLS (TPR@0.1% FPR) Pre: 5.84. Result ID: 6996f5205698665ec441cd4c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### Saliency Map MLS (TPR@0.1% FPR) Pre: 5.84. Result ID: 6996f5205698665ec441cd4d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### Deconvolution MLS (TPR@0.1% FPR) Pre: 5.84. Result ID: 6996f5205698665ec441cd54. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### Deconvolution MLS (TPR@0.1% FPR) Pre: 5.84. Result ID: 6996f5205698665ec441cd55. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### SmoothGrad MLS (TPR@0.1% FPR) Pre: 6.31. Result ID: 6996f5205698665ec441cd3e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### SmoothGrad MLS (TPR@0.1% FPR) Pre: 6.31. Result ID: 6996f5205698665ec441cd3f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### Guided BackProp MLS (TPR@0.1% FPR) Pre: 6.64. Result ID: 6996f5205698665ec441cd4e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### Guided BackProp MLS (TPR@0.1% FPR) Pre: 6.64. Result ID: 6996f5205698665ec441cd4f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### LIME MLS (TPR@0.1% FPR) Pre: 21.52. Result ID: 6996f5205698665ec441cd4a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### LIME MLS (TPR@0.1% FPR) Pre: 21.52. Result ID: 6996f5205698665ec441cd4b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### SHAP MLS (TPR@0.1% FPR) Pre: 28.83. Result ID: 6996f5205698665ec441cd48. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### SHAP MLS (TPR@0.1% FPR) Pre: 28.83. Result ID: 6996f5205698665ec441cd49. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### DeepLIFT MLS (TPR@0.1% FPR) Pre: 37.61. Result ID: 6996f5205698665ec441cd50. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### DeepLIFT MLS (TPR@0.1% FPR) Pre: 37.61. Result ID: 6996f5205698665ec441cd51. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### Integrated Gradients MLS (TPR@0.1% FPR) Pre: 43.52. Result ID: 6996f5205698665ec441cd42. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### Integrated Gradients MLS (TPR@0.1% FPR) Pre: 43.52. Result ID: 6996f5205698665ec441cd43. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### InputXGrad MLS (TPR@0.1% FPR) Pre: 46.37. Result ID: 6996f5205698665ec441cd52. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### InputXGrad MLS (TPR@0.1% FPR) Pre: 46.37. Result ID: 6996f5205698665ec441cd53. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### ProtoDash MLS (TPR@0.1% FPR) Pre: 52.96. Result ID: 6996f5205698665ec441cd58. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### ProtoDash MLS (TPR@0.1% FPR) Pre: 52.96. Result ID: 6996f5205698665ec441cd59. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. ### Anchors MLS (TPR@0.1% FPR) Pre: 80.8. Result ID: 6996f5205698665ec441cd5a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DeepLeak"}. This record does not assert independent reproduction. ### Anchors MLS (TPR@0.1% FPR) Pre: 80.8. Result ID: 6996f5205698665ec441cd5b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Hardening Method":"DP-SGD"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.