Faithfulness Evaluation on SST2
0.563AUC π-Soft (NS)Grad-ELLM
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Grad-ELLMBackbone=Llama2026.01 | 0.563 | 0.304 | |
| RandomBackbone=Llama2026.01 | 0.549 | 0.318 | |
| Integrated GradientsBackbone=Llama2026.01 | 0.526 | 0.276 | |
| SaliencyBackbone=Llama2026.01 | 0.503 | 0.253 | |
| DeepLIFTBackbone=Llama2026.01 | 0.493 | 0.255 | |
| Input×GradientsBackbone=Llama2026.01 | 0.493 | 0.258 | |
| Layer Gradient×ActivationBackbone=Llama2026.01 | 0.493 | 0.258 | |
| SaliencyBackbone=Mistral2026.01 | 0.413 | 0.347 | |
| SaliencyBackbone=Mistral2026.01 | 0.413 | 0.347 | |
| Grad-ELLMBackbone=Mistral2026.01 | 0.396 | 0.464 | |
| Grad-ELLMBackbone=Mistral2026.01 | 0.396 | 0.464 | |
| AttentionBackbone=Llama2026.01 | 0.361 | 0.165 | |
| Integrated GradientsBackbone=Mistral2026.01 | 0.357 | 0.366 | |
| Integrated GradientsBackbone=Mistral2026.01 | 0.357 | 0.366 | |
| RandomBackbone=Mistral2026.01 | 0.337 | 0.56 | |
| RandomBackbone=Mistral2026.01 | 0.337 | 0.56 | |
| Value ZeroingBackbone=Llama2026.01 | 0.325 | 0.136 | |
| AttentionBackbone=Mistral2026.01 | 0.304 | 0.2 | |
| AttentionBackbone=Mistral2026.01 | 0.304 | 0.2 | |
| DeepLIFTBackbone=Mistral2026.01 | 0.3 | 0.278 | |
| DeepLIFTBackbone=Mistral2026.01 | 0.3 | 0.278 | |
| Input×GradientsBackbone=Mistral2026.01 | 0.297 | 0.277 | |
| Layer Gradient×ActivationBackbone=Mistral2026.01 | 0.297 | 0.275 | |
| Input×GradientsBackbone=Mistral2026.01 | 0.297 | 0.277 | |
| Layer Gradient×ActivationBackbone=Mistral2026.01 | 0.297 | 0.275 | |
| Value ZeroingBackbone=Mistral2026.01 | 0.249 | 0.099 | |
| Value ZeroingBackbone=Mistral2026.01 | 0.249 | 0.099 |