Faithfulness Evaluation on AG-news (test)
2Rate of Label ChangesLIME
Evaluation results
| Method | Links | |
|---|---|---|
| LIMEDefense scenario=No attack, Deletion ratio=10%2026.03 | 2 | |
| ICLDefense scenario=No attack, Deletion ratio=10%2026.03 | 3 | |
| LIMEDefense scenario=No attack, Deletion ratio=20%2026.03 | 3.5 | |
| ICLDefense scenario=No attack, Deletion ratio=20%2026.03 | 4 | |
| ICLDefense scenario=Adv. attack, Deletion ratio=10%2026.03 | 11.5 | |
| ICLDefense scenario=Adv. attack, Deletion ratio=20%2026.03 | 13 | |
| ICLDefense scenario=Backdoor attack, Deletion ratio=10%2026.03 | 14 | |
| ShapleyDefense scenario=No attack, Deletion ratio=10%2026.03 | 15 | |
| EnsembleSHAPDefense scenario=No attack, Deletion ratio=10%2026.03 | 17.5 | |
| LIMEDefense scenario=Adv. attack, Deletion ratio=10%2026.03 | 20 | |
| LIMEDefense scenario=Backdoor attack, Deletion ratio=10%2026.03 | 20.5 | |
| ICLDefense scenario=Backdoor attack, Deletion ratio=20%2026.03 | 23.5 | |
| LIMEDefense scenario=Adv. attack, Deletion ratio=20%2026.03 | 26.5 | |
| ShapleyDefense scenario=No attack, Deletion ratio=20%2026.03 | 28 | |
| LIMEDefense scenario=Backdoor attack, Deletion ratio=20%2026.03 | 30 | |
| EnsembleSHAPDefense scenario=No attack, Deletion ratio=20%2026.03 | 41 | |
| ShapleyDefense scenario=Backdoor attack, Deletion ratio=10%2026.03 | 72.5 | |
| EnsembleSHAPDefense scenario=Backdoor attack, Deletion ratio=10%2026.03 | 73.5 | |
| ShapleyDefense scenario=Backdoor attack, Deletion ratio=20%2026.03 | 79 | |
| EnsembleSHAPDefense scenario=Backdoor attack, Deletion ratio=20%2026.03 | 79.5 | |
| ShapleyDefense scenario=Adv. attack, Deletion ratio=10%2026.03 | 85 | |
| EnsembleSHAPDefense scenario=Adv. attack, Deletion ratio=10%2026.03 | 90.5 | |
| ShapleyDefense scenario=Adv. attack, Deletion ratio=20%2026.03 | 96 | |
| EnsembleSHAPDefense scenario=Adv. attack, Deletion ratio=20%2026.03 | 97 |