List your company
ResearchFormerly WizWand

Explanation Faithfulness on SST-2

-0.675Delta AFSmoothGrad
-0.78112-0.064810.65151.36781Jun 11, 2024
Updated 8mo ago

Evaluation results

MethodLinks
SmoothGradBackbone=Mamba 2.8B2024.06-0.675
SmoothGradBackbone=Mamba 1.4B2024.06-0.383
RandomBackbone=Mamba 1.4B2024.06-0.106
GIBackbone=Mamba 1.4B2024.06-0.106
GIBackbone=Mamba 2.8B2024.06-0.043
RandomBackbone=Mamba 130M2024.06-0.012
RandomBackbone=Mamba 2.8B2024.060.007
GIBackbone=Mamba 130M2024.060.078
IGBackbone=Mamba 1.4B2024.060.216
IGBackbone=Mamba 2.8B2024.060.322
MambaAttrBackbone=Mamba 2.8B2024.060.341
AttnRollBackbone=Mamba 1.4B2024.060.431
AttnRollBackbone=Mamba 2.8B2024.060.452
MambaAttrBackbone=Mamba 1.4B2024.060.626
AttnRollBackbone=Mamba 130M2024.060.657
LRPBackbone=Mamba 2.8B, Rule=LN-rule2024.060.82
IGBackbone=Mamba 130M2024.060.857
LRPBackbone=Mamba 130M, Rule=LN-rule2024.060.877
LRPBackbone=Mamba 1.4B, Rule=LN-rule2024.060.961
MambaLRPBackbone=Mamba 2.8B2024.061.157
MambaAttrBackbone=Mamba 130M2024.061.19
MambaLRPBackbone=Mamba 1.4B2024.061.248
SmoothGradBackbone=Mamba 130M2024.061.377
MambaLRPBackbone=Mamba 130M2024.061.978