List your company
ResearchFormerly WizWand

Faithfulness Evaluation on SST-2 (test)

5.5Rate of Label ChangesICL
2.224.47546.7569.025Mar 31, 2026
Updated 7mo ago

Evaluation results

MethodLinks
ICLDefense scenario=Backdoor attack, Deletion ratio=10%2026.035.5
LIMEDefense scenario=Backdoor attack, Deletion ratio=10%2026.038
ICLDefense scenario=Backdoor attack, Deletion ratio=20%2026.038.5
ICLDefense scenario=No attack, Deletion ratio=10%2026.039.5
LIMEDefense scenario=Backdoor attack, Deletion ratio=20%2026.039.5
LIMEDefense scenario=Adv. attack, Deletion ratio=10%2026.0310
LIMEDefense scenario=No attack, Deletion ratio=10%2026.0312.5
ICLDefense scenario=Adv. attack, Deletion ratio=10%2026.0313
ICLDefense scenario=No attack, Deletion ratio=20%2026.0313.5
LIMEDefense scenario=No attack, Deletion ratio=20%2026.0314.5
LIMEDefense scenario=Adv. attack, Deletion ratio=20%2026.0316
ICLDefense scenario=Adv. attack, Deletion ratio=20%2026.0317
ShapleyDefense scenario=No attack, Deletion ratio=10%2026.0332
EnsembleSHAPDefense scenario=No attack, Deletion ratio=10%2026.0336.5
ShapleyDefense scenario=Backdoor attack, Deletion ratio=10%2026.0338
EnsembleSHAPDefense scenario=Backdoor attack, Deletion ratio=10%2026.0340
ShapleyDefense scenario=No attack, Deletion ratio=20%2026.0353
ShapleyDefense scenario=Adv. attack, Deletion ratio=10%2026.0360
EnsembleSHAPDefense scenario=No attack, Deletion ratio=20%2026.0360.5
ShapleyDefense scenario=Backdoor attack, Deletion ratio=20%2026.0363
EnsembleSHAPDefense scenario=Backdoor attack, Deletion ratio=20%2026.0365.5
EnsembleSHAPDefense scenario=Adv. attack, Deletion ratio=10%2026.0368
ShapleyDefense scenario=Adv. attack, Deletion ratio=20%2026.0384
EnsembleSHAPDefense scenario=Adv. attack, Deletion ratio=20%2026.0388