Faithfulness Evaluation on SST-2 (test)
5.5Rate of Label ChangesICL
Evaluation Results
| Method | Links | |
|---|---|---|
| ICLDefense scenario=Backdoor attack, Deletion ratio=10%2026.03 | 5.5 | |
| LIMEDefense scenario=Backdoor attack, Deletion ratio=10%2026.03 | 8 | |
| ICLDefense scenario=Backdoor attack, Deletion ratio=20%2026.03 | 8.5 | |
| ICLDefense scenario=No attack, Deletion ratio=10%2026.03 | 9.5 | |
| LIMEDefense scenario=Backdoor attack, Deletion ratio=20%2026.03 | 9.5 | |
| LIMEDefense scenario=Adv. attack, Deletion ratio=10%2026.03 | 10 | |
| LIMEDefense scenario=No attack, Deletion ratio=10%2026.03 | 12.5 | |
| ICLDefense scenario=Adv. attack, Deletion ratio=10%2026.03 | 13 | |
| ICLDefense scenario=No attack, Deletion ratio=20%2026.03 | 13.5 | |
| LIMEDefense scenario=No attack, Deletion ratio=20%2026.03 | 14.5 | |
| LIMEDefense scenario=Adv. attack, Deletion ratio=20%2026.03 | 16 | |
| ICLDefense scenario=Adv. attack, Deletion ratio=20%2026.03 | 17 | |
| ShapleyDefense scenario=No attack, Deletion ratio=10%2026.03 | 32 | |
| EnsembleSHAPDefense scenario=No attack, Deletion ratio=10%2026.03 | 36.5 | |
| ShapleyDefense scenario=Backdoor attack, Deletion ratio=10%2026.03 | 38 | |
| EnsembleSHAPDefense scenario=Backdoor attack, Deletion ratio=10%2026.03 | 40 | |
| ShapleyDefense scenario=No attack, Deletion ratio=20%2026.03 | 53 | |
| ShapleyDefense scenario=Adv. attack, Deletion ratio=10%2026.03 | 60 | |
| EnsembleSHAPDefense scenario=No attack, Deletion ratio=20%2026.03 | 60.5 | |
| ShapleyDefense scenario=Backdoor attack, Deletion ratio=20%2026.03 | 63 | |
| EnsembleSHAPDefense scenario=Backdoor attack, Deletion ratio=20%2026.03 | 65.5 | |
| EnsembleSHAPDefense scenario=Adv. attack, Deletion ratio=10%2026.03 | 68 | |
| ShapleyDefense scenario=Adv. attack, Deletion ratio=20%2026.03 | 84 | |
| EnsembleSHAPDefense scenario=Adv. attack, Deletion ratio=20%2026.03 | 88 |