Explanation Faithfulness on SNLI
0.989Delta AFMambaLRP
Evaluation results
| Method | Links | |
|---|---|---|
| MambaLRPBackbone=Mamba 130M2024.06 | 0.989 | |
| MambaLRPBackbone=Mamba 2.8B2024.06 | 0.899 | |
| MambaLRPBackbone=Mamba 1.4B2024.06 | 0.897 | |
| LRPBackbone=Mamba 2.8B, Rule=LN-rule2024.06 | 0.731 | |
| LRPBackbone=Mamba 130M, Rule=LN-rule2024.06 | 0.673 | |
| LRPBackbone=Mamba 1.4B, Rule=LN-rule2024.06 | 0.656 | |
| MambaAttrBackbone=Mamba 1.4B2024.06 | 0.554 | |
| MambaAttrBackbone=Mamba 130M2024.06 | 0.513 | |
| SmoothGradBackbone=Mamba 130M2024.06 | 0.486 | |
| IGBackbone=Mamba 130M2024.06 | 0.453 | |
| AttnRollBackbone=Mamba 1.4B2024.06 | 0.371 | |
| MambaAttrBackbone=Mamba 2.8B2024.06 | 0.343 | |
| IGBackbone=Mamba 2.8B2024.06 | 0.331 | |
| AttnRollBackbone=Mamba 2.8B2024.06 | 0.292 | |
| AttnRollBackbone=Mamba 130M2024.06 | 0.242 | |
| IGBackbone=Mamba 1.4B2024.06 | 0.218 | |
| GIBackbone=Mamba 2.8B2024.06 | 0.083 | |
| RandomBackbone=Mamba 130M2024.06 | 0.01 | |
| RandomBackbone=Mamba 1.4B2024.06 | 0.002 | |
| RandomBackbone=Mamba 2.8B2024.06 | 0 | |
| GIBackbone=Mamba 130M2024.06 | -0.039 | |
| GIBackbone=Mamba 1.4B2024.06 | -0.039 | |
| SmoothGradBackbone=Mamba 1.4B2024.06 | -0.687 | |
| SmoothGradBackbone=Mamba 2.8B2024.06 | -0.747 |