Concept Attribution on iSarcasm (test)
94Attribution F1RISE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RISEConcept Type=Super Activators, Model=Gemma-2-9B2025.12 | 94 | 40.9 | 0.5 | |
| SHAP IQConcept Type=Super Activators, Model=Gemma-2-9B2025.12 | 92 | 40.7 | 0.6 | |
| CALMConcept Type=Super Activators, Model=Gemma-2-9B2025.12 | 91 | 40.8 | 0.6 | |
| SHAPConcept Type=Super Activators, Model=Gemma-2-9B2025.12 | 90 | 41 | 0.6 | |
| MFABAConcept Type=Super Activators, Model=Gemma-2-9B2025.12 | 90 | 42 | 0.3 | |
| LIMEConcept Type=Super Activators, Model=Gemma-2-9B2025.12 | 89 | 41.2 | 0.5 | |
| GradCAMConcept Type=Super Activators, Model=Gemma-2-9B2025.12 | 87 | 40.3 | 0.7 | |
| FullGradConcept Type=Super Activators, Model=Gemma-2-9B2025.12 | 85 | 40.2 | 0.7 | |
| IntGradConcept Type=Super Activators, Model=Gemma-2-9B2025.12 | 84 | 40.5 | 0.8 | |
| RISEConcept Type=Concept, Model=Gemma-2-9B2025.12 | 81 | 38.2 | 0.8 | |
| SHAP IQConcept Type=Concept, Model=Gemma-2-9B2025.12 | 79 | 37.9 | 0.9 | |
| CALMConcept Type=Concept, Model=Gemma-2-9B2025.12 | 78 | 38 | 0.9 | |
| SHAPConcept Type=Concept, Model=Gemma-2-9B2025.12 | 77 | 38.4 | 0.9 | |
| MFABAConcept Type=Concept, Model=Gemma-2-9B2025.12 | 77 | 39.1 | 0.6 | |
| LIMEConcept Type=Concept, Model=Gemma-2-9B2025.12 | 76 | 38.3 | 0.9 | |
| GradCAMConcept Type=Concept, Model=Gemma-2-9B2025.12 | 74 | 37.7 | 1 | |
| FullGradConcept Type=Concept, Model=Gemma-2-9B2025.12 | 73 | 37.6 | 1 | |
| IntGradConcept Type=Concept, Model=Gemma-2-9B2025.12 | 72 | 37.5 | 1.1 |