Concept Attribution on COCO (test)
43Attribution F1FullGrad
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| FullGradConcept Type=Concept, Model=CLIP-ViT-L/142025.12 | 43 | 33.1 | 1.1 | |
| FullGradConcept Type=Super Activators, Model=CLIP-ViT-L/142025.12 | 43 | 35.7 | 0.9 | |
| CALMConcept Type=Concept, Model=CLIP-ViT-L/142025.12 | 42 | 33.2 | 1.1 | |
| CALMConcept Type=Super Activators, Model=CLIP-ViT-L/142025.12 | 42 | 36 | 0.8 | |
| LIMEConcept Type=Super Activators, Model=CLIP-ViT-L/142025.12 | 40 | 36.7 | 0.7 | |
| MFABAConcept Type=Super Activators, Model=CLIP-ViT-L/142025.12 | 39 | 37.4 | 0.4 | |
| RISEConcept Type=Super Activators, Model=CLIP-ViT-L/142025.12 | 38 | 35.4 | 0.9 | |
| GradCAMConcept Type=Super Activators, Model=CLIP-ViT-L/142025.12 | 38 | 35.2 | 1 | |
| SHAPConcept Type=Super Activators, Model=CLIP-ViT-L/142025.12 | 37 | 36.5 | 0.8 | |
| SHAP IQConcept Type=Super Activators, Model=CLIP-ViT-L/142025.12 | 37 | 35.8 | 0.9 | |
| GradCAMConcept Type=Concept, Model=CLIP-ViT-L/142025.12 | 37 | 32.9 | 1.2 | |
| SHAPConcept Type=Concept, Model=CLIP-ViT-L/142025.12 | 35 | 33.4 | 1 | |
| RISEConcept Type=Concept, Model=CLIP-ViT-L/142025.12 | 35 | 32.8 | 1.2 | |
| IntGradConcept Type=Super Activators, Model=CLIP-ViT-L/142025.12 | 35 | 35.9 | 1 | |
| SHAP IQConcept Type=Concept, Model=CLIP-ViT-L/142025.12 | 34 | 33 | 1.1 | |
| MFABAConcept Type=Concept, Model=CLIP-ViT-L/142025.12 | 33 | 33.9 | 0.6 | |
| LIMEConcept Type=Concept, Model=CLIP-ViT-L/142025.12 | 29 | 33.3 | 1 | |
| IntGradConcept Type=Concept, Model=CLIP-ViT-L/142025.12 | 28 | 32.6 | 1.3 |