Sensitivity of Attention-Based Attribution on Imagenette 224x224
0.5Attribution Raw ScoreSharp. Aware Min. (SAM)
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Sharp. Aware Min. (SAM)Backbone=ViT-B/16, Attention Mechanism=Unnorm. Kern.2026.05 | 0.5 | 0.08 | 0.27 | 0.19 | 0.69 | 4.78 | |
| No Regularization (Base)Backbone=ViT-B/16, Attention Mechanism=Unnorm. Kern.2026.05 | 0.47 | 0.09 | 0.29 | 0.17 | 0.73 | 4.66 | |
| Explicit Curv. Reg. (ECR)Backbone=ViT-B/16, Attention Mechanism=Unnorm. Kern.2026.05 | 0.35 | 0.2 | 0.85 | 0.24 | 0.88 | 3.67 | |
| Implicit Curv. Reg. (ICR†)Backbone=ViT-B/16, Attention Mechanism=Unnorm. Kern.2026.05 | 0.33 | 0.09 | 0.17 | 0.15 | 1.01 | 4.22 | |
| Explicit Curv. Reg. (ECR)Backbone=ViT-Tiny, Attention Mechanism=Softmax Attn.2026.05 | 0.23 | 0.12 | 0.3 | 0.4 | 0.03 | 5.02 | |
| Adv. Trainig Reg. (ATR)Backbone=ViT-B/16, Attention Mechanism=Unnorm. Kern.2026.05 | 0.17 | 0.09 | 0.26 | 0.11 | 0.62 | 4.69 | |
| No Regularization (Base)Backbone=ViT-Tiny, Attention Mechanism=Softmax Attn.2026.05 | 0.14 | 0.03 | 0.12 | 0.19 | 0.03 | 5.26 | |
| Implicit Curv. Reg. (ICR†)Backbone=ViT-Tiny, Attention Mechanism=Softmax Attn.2026.05 | 0.14 | 0.11 | 0.35 | 0.4 | 0.04 | 5.03 | |
| Ante-hoc Act. Reg. (AAR)Backbone=ViT-Tiny, Attention Mechanism=Softmax Attn.2026.05 | 0.13 | 0.03 | 0.11 | 0.17 | 0.02 | 5.27 | |
| Sharp. Aware Min. (SAM)Backbone=ViT-Tiny, Attention Mechanism=Softmax Attn.2026.05 | 0.13 | 0.03 | 0.12 | 0.18 | 0.03 | 5.27 | |
| Post-hoc Act. Reg. (PAR)Backbone=ViT-Tiny, Attention Mechanism=Softmax Attn.2026.05 | 0.12 | 0.03 | 0.12 | 0.18 | 0.03 | 5.27 | |
| Adv. Trainig Reg. (ATR)Backbone=ViT-Tiny, Attention Mechanism=Softmax Attn.2026.05 | 0.1 | 0.02 | 0.1 | 0.16 | 0.03 | 5.27 |