XAI Evaluation on ImageNet-S (val)
6.029Selection ScoreFeature Ablation
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Feature AblationLayer=0, Abs=y, Backbone=VGG162026.01 | 6.029 | 0.479 | 0.624 | 12.3 | 1.25 | 0.859 | |
| GradCAMLayer=0, Abs=n, Backbone=VGG162026.01 | 6.006 | 0.356 | 0.638 | 6 | 0.899 | 1.123 | |
| GradCAM++Layer=30, Abs=n, Backbone=VGG162026.01 | 5.955 | 0.564 | 0.827 | 13 | 1.245 | 0.401 | |
| SplitGrad (α 0.4)Layer=(12, +, g), Abs=n, Backbone=VGG162026.01 | 5.633 | 0.613 | 0.873 | 14.8 | 1.461 | 0.364 | |
| DeconvolutionLayer=0, Abs=y, Backbone=VGG162026.01 | 5.435 | 0.468 | 0.629 | 20.4 | 1.715 | 0.956 | |
| OcclusionLayer=0, Abs=y, Backbone=VGG162026.01 | 5.214 | 0.499 | 0.716 | 13 | 1.217 | 0.699 | |
| SplitLRP (sc, wta)Layer=(26, pos), Abs=y, Backbone=VGG162026.01 | 5.168 | 0.588 | 0.871 | 15.1 | 1.473 | 0.282 | |
| Guided GradCAMLayer=26, Abs=n, Backbone=VGG162026.01 | 5.13 | -2.635 | 0.843 | 17.9 | 1.415 | 0.947 | |
| SplitGrad (α 0.5, wta)Layer=(26, +, g), Abs=y, Backbone=VGG162026.01 | 4.948 | 0.543 | 0.899 | 16.2 | 1.527 | 0.617 | |
| Integrated GradientsLayer=0, Abs=y, Backbone=VGG162026.01 | 4.838 | 0.554 | 0.797 | 26.2 | 1.851 | 1.069 | |
| Gradient SHAPLayer=0, Abs=y, Backbone=VGG162026.01 | 4.808 | 0.552 | 0.783 | 26.1 | 1.862 | 1.142 | |
| SplitGrad (α 0.4, wta)Layer=(12, +, g), Abs=n, Backbone=VGG162026.01 | 4.735 | 0.635 | 0.883 | 18.6 | 1.756 | 0.651 | |
| SplitCAM (sc, α 0.4)Layer=(12, g), Abs=n, Backbone=VGG162026.01 | 4.72 | 0.651 | 0.912 | 21.3 | 1.794 | 0.389 | |
| SplitCAM (sc, α 0.4, wta)Layer=(26, +, g), Abs=y, Backbone=VGG162026.01 | 4.711 | 0.635 | 0.938 | 16.5 | 1.59 | 0.456 | |
| SplitCAM (sc, α 0.5, wta)Layer=(26, +, g), Abs=n, Backbone=VGG162026.01 | 4.608 | 0.607 | 0.903 | 18.5 | 1.684 | 0.566 | |
| DeepLiftLayer=0, Abs=y, Backbone=VGG162026.01 | 4.447 | 0.551 | 0.726 | 28.1 | 1.945 | 1.053 | |
| SplitLRP (sc)Layer=(19, pos), Abs=n, Backbone=VGG162026.01 | 4.393 | 0.6 | 0.823 | 16.6 | 1.656 | 0.291 | |
| Guided GradCAMLayer=0, Abs=n, Backbone=VGG162026.01 | 4.301 | -0.053 | 0.857 | 16.1 | 1.459 | 1.047 | |
| Guided BackpropLayer=5, Abs=n, Backbone=VGG162026.01 | 3.448 | 0.614 | 0.887 | 24 | 2.091 | 0.375 | |
| SplitGrad (α 0.4)Layer=(14, +, g), Abs=y, Backbone=VGG162026.01 | 3.429 | 0.533 | 0.82 | 23.5 | 2.119 | 0.851 | |
| SplitGrad (α 0.5, wta)Layer=(12, +, g), Abs=y, Backbone=VGG162026.01 | 3.379 | 0.551 | 0.859 | 26.1 | 2.22 | 0.869 | |
| SplitGrad (α 0.4, wta)Layer=(14, +, g), Abs=y, Backbone=VGG162026.01 | 3.287 | 0.54 | 0.818 | 24.9 | 2.186 | 0.857 | |
| Guided BackpropLayer=2, Abs=n, Backbone=VGG162026.01 | 3.276 | 0.632 | 0.883 | 28.1 | 2.302 | 0.571 | |
| SplitLRP (sc, wta)Layer=(7, pos), Abs=n, Backbone=VGG162026.01 | 3.235 | -0.036 | 0.836 | 29.6 | 2.291 | 0.866 | |
| SplitLRP (sc)Layer=(7, pos), Abs=n, Backbone=VGG162026.01 | 3.062 | 0.092 | 0.857 | 29.6 | 2.29 | 0.865 | |
| SplitCAM (sc, α 0.5, wta)Layer=(14, g), Abs=n, Backbone=VGG162026.01 | 2.766 | 0.536 | 0.823 | 30.3 | 2.416 | 1.056 | |
| SplitCAM (sc, α 0.4, wta)Layer=(14, g), Abs=n, Backbone=VGG162026.01 | 2.761 | 0.543 | 0.827 | 30.3 | 2.414 | 1.056 | |
| SplitCAM (sc, α 0.4)Layer=(14, g), Abs=n, Backbone=VGG162026.01 | 2.727 | 0.563 | 0.836 | 30 | 2.404 | 1.012 |