Concept Attribution on CLEVR
51Avg Attribution F1SHAP
Evaluation results
| Method | Links | |
|---|---|---|
| SHAPActivation Source=SuperActivators, Model=CLIP, Framework=SAEs2025.12 | 51 | |
| LIMEActivation Source=SuperActivators, Model=CLIP, Framework=SAEs2025.12 | 49 | |
| CALMActivation Source=SuperActivators, Model=CLIP, Framework=SAEs2025.12 | 49 | |
| MFABAActivation Source=SuperActivators, Model=CLIP, Framework=SAEs2025.12 | 49 | |
| RISEActivation Source=SuperActivators, Model=CLIP, Framework=SAEs2025.12 | 48 | |
| SHAPActivation Source=CLS, Model=CLIP, Framework=SAEs2025.12 | 47 | |
| SHAP IQActivation Source=CLS, Model=CLIP, Framework=SAEs2025.12 | 46 | |
| SHAP IQActivation Source=SuperActivators, Model=CLIP, Framework=SAEs2025.12 | 46 | |
| LIMEActivation Source=CLS, Model=CLIP, Framework=SAEs2025.12 | 45 | |
| RISEActivation Source=CLS, Model=CLIP, Framework=SAEs2025.12 | 44 | |
| IntGradActivation Source=SuperActivators, Model=CLIP, Framework=SAEs2025.12 | 44 | |
| CALMActivation Source=CLS, Model=CLIP, Framework=SAEs2025.12 | 44 | |
| MFABAActivation Source=CLS, Model=CLIP, Framework=SAEs2025.12 | 44 | |
| FullGradActivation Source=SuperActivators, Model=CLIP, Framework=SAEs2025.12 | 41 | |
| IntGradActivation Source=CLS, Model=CLIP, Framework=SAEs2025.12 | 40 | |
| GradCAMActivation Source=SuperActivators, Model=CLIP, Framework=SAEs2025.12 | 40 | |
| FullGradActivation Source=CLS, Model=CLIP, Framework=SAEs2025.12 | 37 | |
| GradCAMActivation Source=CLS, Model=CLIP, Framework=SAEs2025.12 | 36 |