Explanation Faithfulness on SST-2
-0.675Delta AFSmoothGrad
Evaluation Results
| Method | Links | |
|---|---|---|
| SmoothGradBackbone=Mamba 2.8B2024.06 | -0.675 | |
| SmoothGradBackbone=Mamba 1.4B2024.06 | -0.383 | |
| RandomBackbone=Mamba 1.4B2024.06 | -0.106 | |
| GIBackbone=Mamba 1.4B2024.06 | -0.106 | |
| GIBackbone=Mamba 2.8B2024.06 | -0.043 | |
| RandomBackbone=Mamba 130M2024.06 | -0.012 | |
| RandomBackbone=Mamba 2.8B2024.06 | 0.007 | |
| GIBackbone=Mamba 130M2024.06 | 0.078 | |
| IGBackbone=Mamba 1.4B2024.06 | 0.216 | |
| IGBackbone=Mamba 2.8B2024.06 | 0.322 | |
| MambaAttrBackbone=Mamba 2.8B2024.06 | 0.341 | |
| AttnRollBackbone=Mamba 1.4B2024.06 | 0.431 | |
| AttnRollBackbone=Mamba 2.8B2024.06 | 0.452 | |
| MambaAttrBackbone=Mamba 1.4B2024.06 | 0.626 | |
| AttnRollBackbone=Mamba 130M2024.06 | 0.657 | |
| LRPBackbone=Mamba 2.8B, Rule=LN-rule2024.06 | 0.82 | |
| IGBackbone=Mamba 130M2024.06 | 0.857 | |
| LRPBackbone=Mamba 130M, Rule=LN-rule2024.06 | 0.877 | |
| LRPBackbone=Mamba 1.4B, Rule=LN-rule2024.06 | 0.961 | |
| MambaLRPBackbone=Mamba 2.8B2024.06 | 1.157 | |
| MambaAttrBackbone=Mamba 130M2024.06 | 1.19 | |
| MambaLRPBackbone=Mamba 1.4B2024.06 | 1.248 | |
| SmoothGradBackbone=Mamba 130M2024.06 | 1.377 | |
| MambaLRPBackbone=Mamba 130M2024.06 | 1.978 |