Faithfulness Evaluation on IMDb (test) (Rate of Label Changes)
4.5Rate of Label ChangesICL
Evaluation results
| Method | Links | |
|---|---|---|
| ICLDefense scenario=No attack, Deletion ratio=10%2026.03 | 4.5 | |
| ICLDefense scenario=No attack, Deletion ratio=20%2026.03 | 5 | |
| LIMEDefense scenario=No attack, Deletion ratio=10%2026.03 | 6 | |
| LIMEDefense scenario=No attack, Deletion ratio=20%2026.03 | 9.5 | |
| LIMEDefense scenario=Backdoor attack, Deletion ratio=10%2026.03 | 12 | |
| ICLDefense scenario=Backdoor attack, Deletion ratio=10%2026.03 | 12 | |
| ICLDefense scenario=Backdoor attack, Deletion ratio=20%2026.03 | 17 | |
| LIMEDefense scenario=Backdoor attack, Deletion ratio=20%2026.03 | 18 | |
| LIMEDefense scenario=Adv. attack, Deletion ratio=10%2026.03 | 28 | |
| ShapleyDefense scenario=No attack, Deletion ratio=10%2026.03 | 30 | |
| ICLDefense scenario=Adv. attack, Deletion ratio=10%2026.03 | 30.5 | |
| ShapleyDefense scenario=No attack, Deletion ratio=20%2026.03 | 33 | |
| LIMEDefense scenario=Adv. attack, Deletion ratio=20%2026.03 | 33.5 | |
| ICLDefense scenario=Adv. attack, Deletion ratio=20%2026.03 | 36.5 | |
| ShapleyDefense scenario=Backdoor attack, Deletion ratio=10%2026.03 | 52 | |
| ShapleyDefense scenario=Backdoor attack, Deletion ratio=20%2026.03 | 54 | |
| EnsembleSHAPDefense scenario=No attack, Deletion ratio=10%2026.03 | 60 | |
| EnsembleSHAPDefense scenario=No attack, Deletion ratio=20%2026.03 | 74.5 | |
| EnsembleSHAPDefense scenario=Backdoor attack, Deletion ratio=10%2026.03 | 81 | |
| ShapleyDefense scenario=Adv. attack, Deletion ratio=20%2026.03 | 84 | |
| ShapleyDefense scenario=Adv. attack, Deletion ratio=10%2026.03 | 84.5 | |
| EnsembleSHAPDefense scenario=Backdoor attack, Deletion ratio=20%2026.03 | 91 | |
| EnsembleSHAPDefense scenario=Adv. attack, Deletion ratio=10%2026.03 | 98 | |
| EnsembleSHAPDefense scenario=Adv. attack, Deletion ratio=20%2026.03 | 100 |