Concept Attribution on iSarcasm
94Avg F1LIME
Evaluation Results
| Method | Links | |
|---|---|---|
| LIMEModel=Gemma, Target=Super Activators, Protocol=K-LinSep2025.12 | 94 | |
| RISEModel=Gemma, Target=Super Activators, Protocol=LinSep2025.12 | 94 | |
| SHAPModel=Gemma, Target=Super Activators, Protocol=K-LinSep2025.12 | 92 | |
| RISEModel=Llama, Target=Super Activators, Protocol=LinSep2025.12 | 92 | |
| SHAP IQModel=Gemma, Target=Super Activators, Protocol=LinSep2025.12 | 92 | |
| CALMModel=Gemma, Target=Super Activators, Protocol=LinSep2025.12 | 91 | |
| SHAPModel=Gemma, Target=Super Activators, Protocol=LinSep2025.12 | 90 | |
| SHAP IQModel=Llama, Target=Super Activators, Protocol=LinSep2025.12 | 90 | |
| MFABAModel=Gemma, Target=Super Activators, Protocol=LinSep2025.12 | 90 | |
| LIMEModel=Gemma, Target=Super Activators, Protocol=LinSep2025.12 | 89 | |
| RISEModel=Qwen, Target=Super Activators, Protocol=K-LinSep2025.12 | 89 | |
| CALMModel=Llama, Target=Super Activators, Protocol=LinSep2025.12 | 89 | |
| SHAPModel=Llama, Target=Super Activators, Protocol=LinSep2025.12 | 88 | |
| SHAPModel=Llama, Target=Super Activators, Protocol=K-LinSep2025.12 | 88 | |
| IntGradModel=Gemma, Target=Super Activators, Protocol=K-LinSep2025.12 | 88 | |
| MFABAModel=Llama, Target=Super Activators, Protocol=LinSep2025.12 | 88 | |
| MFABAModel=Gemma, Target=Super Activators, Protocol=K-LinSep2025.12 | 88 | |
| LIMEModel=Llama, Target=Super Activators, Protocol=LinSep2025.12 | 87 | |
| GradCAMModel=Gemma, Target=Super Activators, Protocol=LinSep2025.12 | 87 | |
| FullGradModel=Gemma, Target=Super Activators, Protocol=K-LinSep2025.12 | 87 | |
| GradCAMModel=Llama, Target=Super Activators, Protocol=LinSep2025.12 | 86 | |
| RISEModel=Qwen, Target=Super Activators, Protocol=LinSep2025.12 | 85 | |
| RISEModel=Gemma, Target=Super Activators, Protocol=K-LinSep2025.12 | 85 | |
| SHAP IQModel=Llama, Target=Super Activators, Protocol=K-Means2025.12 | 85 | |
| SHAP IQModel=Llama, Target=Concept, Protocol=K-LinSep2025.12 | 85 | |
| FullGradModel=Gemma, Target=Super Activators, Protocol=LinSep2025.12 | 85 | |
| MFABAModel=Llama, Target=Super Activators, Protocol=K-LinSep2025.12 | 85 | |
| RISEModel=Llama, Target=Concept, Protocol=LinSep2025.12 | 84 | |
| RISEModel=Llama, Target=Concept, Protocol=K-LinSep2025.12 | 84 | |
| RISEModel=Llama, Target=Super Activators, Protocol=K-LinSep2025.12 | 84 | |
| RISEModel=Gemma, Target=Concept, Protocol=K-LinSep2025.12 | 84 | |
| IntGradModel=Gemma, Target=Super Activators, Protocol=LinSep2025.12 | 84 | |
| Direct AlignmentModel=Gemma, Target=Concept, Protocol=LinSep2025.12 | 83 | |
| LIMEModel=Qwen, Target=Super Activators, Protocol=K-LinSep2025.12 | 83 | |
| SHAPModel=Llama, Target=Super Activators, Protocol=K-Means2025.12 | 83 | |
| RISEModel=Llama, Target=Super Activators, Protocol=Avg2025.12 | 83 | |
| SHAP IQModel=Qwen, Target=Super Activators, Protocol=LinSep2025.12 | 83 | |
| SHAP IQModel=Llama, Target=Super Activators, Protocol=K-LinSep2025.12 | 83 | |
| FullGradModel=Llama, Target=Super Activators, Protocol=LinSep2025.12 | 83 | |
| SHAP IQModel=Llama, Target=Concept, Protocol=LinSep2025.12 | 82 | |
| SHAP IQModel=Qwen, Target=Super Activators, Protocol=K-LinSep2025.12 | 82 | |
| SHAP IQModel=Gemma, Target=Super Activators, Protocol=K-LinSep2025.12 | 82 | |
| IntGradModel=Llama, Target=Super Activators, Protocol=LinSep2025.12 | 82 | |
| FullGradModel=Llama, Target=Super Activators, Protocol=K-LinSep2025.12 | 82 | |
| CALMModel=Llama, Target=Super Activators, Protocol=K-LinSep2025.12 | 82 | |
| Direct AlignmentModel=Llama, Target=Concept, Protocol=LinSep2025.12 | 81 | |
| SHAPModel=Qwen, Target=Super Activators, Protocol=LinSep2025.12 | 81 | |
| SHAPModel=Llama, Target=Concept, Protocol=K-LinSep2025.12 | 81 | |
| RISEModel=Gemma, Target=Concept, Protocol=LinSep2025.12 | 81 | |
| RISEModel=Gemma, Target=Super Activators, Protocol=K-Means2025.12 | 81 | |
| SHAP IQModel=Llama, Target=Super Activators, Protocol=Avg2025.12 | 81 | |
| CALMModel=Llama, Target=Concept, Protocol=LinSep2025.12 | 81 | |
| CALMModel=Qwen, Target=Super Activators, Protocol=LinSep2025.12 | 81 | |
| MFABAModel=Llama, Target=Concept, Protocol=K-LinSep2025.12 | 81 | |
| LIMEModel=Qwen, Target=Super Activators, Protocol=LinSep2025.12 | 80 | |
| LIMEModel=Llama, Target=Super Activators, Protocol=K-LinSep2025.12 | 80 | |
| SHAPModel=Llama, Target=Concept, Protocol=LinSep2025.12 | 80 | |
| RISEModel=Llama, Target=Concept, Protocol=K-Means2025.12 | 80 | |
| RISEModel=Llama, Target=Super Activators, Protocol=K-Means2025.12 | 80 | |
| SHAP IQModel=Gemma, Target=Super Activators, Protocol=K-Means2025.12 | 80 | |
| SHAP IQModel=Gemma, Target=Concept, Protocol=K-LinSep2025.12 | 80 | |
| CALMModel=Llama, Target=Concept, Protocol=K-LinSep2025.12 | 80 | |
| MFABAModel=Llama, Target=Concept, Protocol=LinSep2025.12 | 80 | |
| MFABAModel=Qwen, Target=Super Activators, Protocol=LinSep2025.12 | 80 | |
| MFABAModel=Gemma, Target=Concept, Protocol=K-LinSep2025.12 | 80 | |
| LIMEModel=Llama, Target=Concept, Protocol=LinSep2025.12 | 79 | |
| SHAPModel=Llama, Target=Super Activators, Protocol=Avg2025.12 | 79 | |
| SHAPModel=Qwen, Target=Super Activators, Protocol=K-LinSep2025.12 | 79 | |
| RISEModel=Gemma, Target=Super Activators, Protocol=Avg2025.12 | 79 | |
| SHAP IQModel=Gemma, Target=Concept, Protocol=LinSep2025.12 | 79 | |
| CALMModel=Gemma, Target=Super Activators, Protocol=K-LinSep2025.12 | 79 | |
| MFABAModel=Qwen, Target=Super Activators, Protocol=K-LinSep2025.12 | 79 | |
| LIMEModel=Llama, Target=Super Activators, Protocol=Avg2025.12 | 78 | |
| SHAPModel=Gemma, Target=Super Activators, Protocol=K-Means2025.12 | 78 | |
| GradCAMModel=Llama, Target=Concept, Protocol=LinSep2025.12 | 78 | |
| GradCAMModel=Qwen, Target=Super Activators, Protocol=LinSep2025.12 | 78 | |
| GradCAMModel=Gemma, Target=Super Activators, Protocol=K-LinSep2025.12 | 78 | |
| CALMModel=Llama, Target=Super Activators, Protocol=Avg2025.12 | 78 | |
| CALMModel=Gemma, Target=Concept, Protocol=LinSep2025.12 | 78 | |
| SHAPModel=Gemma, Target=Concept, Protocol=LinSep2025.12 | 77 | |
| IntGradModel=Qwen, Target=Super Activators, Protocol=K-LinSep2025.12 | 77 | |
| MFABAModel=Llama, Target=Super Activators, Protocol=Avg2025.12 | 77 | |
| MFABAModel=Gemma, Target=Concept, Protocol=LinSep2025.12 | 77 | |
| LIMEModel=Gemma, Target=Concept, Protocol=LinSep2025.12 | 76 | |
| LIMEModel=Llama, Target=Concept, Protocol=K-LinSep2025.12 | 76 | |
| LIMEModel=Qwen, Target=Concept, Protocol=K-LinSep2025.12 | 76 | |
| LIMEModel=Gemma, Target=Concept, Protocol=K-LinSep2025.12 | 76 | |
| RISEModel=Llama, Target=Concept, Protocol=Avg2025.12 | 76 | |
| RISEModel=Qwen, Target=Concept, Protocol=LinSep2025.12 | 76 | |
| SHAP IQModel=Gemma, Target=Super Activators, Protocol=Avg2025.12 | 76 | |
| GradCAMModel=Gemma, Target=Concept, Protocol=K-LinSep2025.12 | 76 | |
| FullGradModel=Llama, Target=Concept, Protocol=LinSep2025.12 | 76 | |
| FullGradModel=Qwen, Target=Super Activators, Protocol=LinSep2025.12 | 76 | |
| LIMEModel=Llama, Target=Super Activators, Protocol=K-Means2025.12 | 75 | |
| RISEModel=Qwen, Target=Super Activators, Protocol=K-Means2025.12 | 75 | |
| RISEModel=Qwen, Target=Concept, Protocol=K-LinSep2025.12 | 75 | |
| IntGradModel=Llama, Target=Concept, Protocol=LinSep2025.12 | 75 | |
| IntGradModel=Qwen, Target=Super Activators, Protocol=LinSep2025.12 | 75 | |
| IntGradModel=Llama, Target=Concept, Protocol=K-LinSep2025.12 | 75 | |
| GradCAMModel=Llama, Target=Super Activators, Protocol=Avg2025.12 | 75 |