Faithfulness Evaluation of Image Explanation on ImageNet (val)
65.6DeletionRollout
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RolloutText input source=Ground-truth, Rank=@52025.02 | 65.6 | 46.7 | -0.189 | |
| raw attentionText input source=Ground-truth, Rank=@52025.02 | 62.4 | 41.9 | -0.204 | |
| M2IBText input source=Ground-truth, Rank=@52025.02 | 59.5 | 54.1 | -0.054 | |
| M2IBText input source=Prediction, Rank=@52025.02 | 59.5 | 54.1 | -0.054 | |
| GAMEText input source=Prediction, Rank=@52025.02 | 59.4 | 53.8 | -0.055 | |
| Grad-CAMText input source=Prediction, Rank=@52025.02 | 58.2 | 42.1 | -0.161 | |
| GAMEText input source=Ground-truth, Rank=@52025.02 | 57.3 | 56.4 | -0.01 | |
| Grad-CAMText input source=Ground-truth, Rank=@52025.02 | 56.3 | 44.5 | -0.117 | |
| CLIPSurgeryText input source=Prediction, Rank=@52025.02 | 54.1 | 57.2 | 0.03 | |
| CLIPSurgeryText input source=Ground-truth, Rank=@52025.02 | 52.4 | 60.2 | 0.079 | |
| MaskCLIPText input source=Prediction, Rank=@52025.02 | 49.6 | 52.7 | 0.031 | |
| MaskCLIPText input source=Ground-truth, Rank=@52025.02 | 48.9 | 53.5 | 0.047 | |
| Grad-ECLIP w/o λiText input source=Prediction, Rank=@52025.02 | 45.7 | 55.6 | 0.099 | |
| Grad-ECLIPText input source=Prediction, Rank=@52025.02 | 44.2 | 57.5 | 0.133 | |
| Grad-ECLIP w/o λiText input source=Ground-truth, Rank=@52025.02 | 43.8 | 58.3 | 0.145 | |
| Grad-ECLIPText input source=Ground-truth, Rank=@52025.02 | 42.7 | 59.9 | 0.172 | |
| RolloutText input source=Ground-truth, Rank=@12025.02 | 40.8 | 28 | -0.128 | |
| raw attentionText input source=Ground-truth, Rank=@12025.02 | 38.3 | 24.9 | -0.134 | |
| M2IBText input source=Ground-truth, Rank=@12025.02 | 36.3 | 33.5 | -0.028 | |
| M2IBText input source=Prediction, Rank=@12025.02 | 36.3 | 33.5 | -0.029 | |
| Grad-CAMText input source=Prediction, Rank=@12025.02 | 35.2 | 25.3 | -0.099 | |
| GAMEText input source=Prediction, Rank=@12025.02 | 35 | 34.3 | -0.007 | |
| Grad-CAMText input source=Ground-truth, Rank=@12025.02 | 34.2 | 26.8 | -0.074 | |
| GAMEText input source=Ground-truth, Rank=@12025.02 | 33.6 | 36.1 | 0.025 | |
| CLIPSurgeryText input source=Prediction, Rank=@12025.02 | 32.2 | 37.3 | 0.051 | |
| CLIPSurgeryText input source=Ground-truth, Rank=@12025.02 | 31.2 | 38.3 | 0.07 | |
| MaskCLIPText input source=Prediction, Rank=@12025.02 | 28.9 | 32.8 | 0.039 | |
| MaskCLIPText input source=Ground-truth, Rank=@12025.02 | 28.5 | 33.4 | 0.049 | |
| Grad-ECLIP w/o λiText input source=Prediction, Rank=@12025.02 | 26.3 | 35.3 | 0.089 | |
| Grad-ECLIPText input source=Prediction, Rank=@12025.02 | 25.4 | 36.7 | 0.113 | |
| Grad-ECLIP w/o λiText input source=Ground-truth, Rank=@12025.02 | 25.4 | 37.2 | 0.118 | |
| Grad-ECLIPText input source=Ground-truth, Rank=@12025.02 | 24.6 | 38.4 | 0.137 |