Textual Adversarial Attack on AG News
7.5Attack Success Rate (ASR)Ensemble
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| EnsembleVictim=SHIELD, Budget=102026.05 | 7.5 | — | — | — | |
| EnsembleVictim=Llama2026.05 | 10.3 | — | — | — | |
| HAWRVictim=HotFlip, Budget=102026.05 | 11.6 | — | — | — | |
| EnsembleVictim=ChatGPT2026.05 | 12.8 | — | — | — | |
| EnsembleVictim=HotFlip, Budget=102026.05 | 14.4 | — | — | — | |
| HAWRVictim=ChatGPT2026.05 | 15.6 | — | — | — | |
| TextFoolerVictim=HotFlip, Budget=1002026.05 | 16 | — | — | — | |
| HAWRVictim=SHIELD, Budget=102026.05 | 16.1 | — | — | — | |
| EnsembleVictim=Mistral2026.05 | 16.5 | — | — | — | |
| HAWRVictim=Llama2026.05 | 18.8 | — | — | — | |
| TextFoolerVictim=SHIELD, Budget=1002026.05 | 19.8 | — | — | — | |
| HAWRVictim=Mistral2026.05 | 20.4 | — | — | — | |
| DeepWordBugVictim=SHIELD, Budget=1002026.05 | 20.9 | — | — | — | |
| TextBuggerVictim=SHIELD, Budget=1002026.05 | 26.4 | — | — | — | |
| DeepWordBugVictim=HotFlip, Budget=1002026.05 | 27 | — | — | — | |
| LeapAttackVictim=HotFlip, Budget=1002026.05 | 27.6 | — | — | — | |
| LeapAttackVictim=SHIELD, Budget=1002026.05 | 28.2 | — | — | — | |
| HQA-AttackVictim=HotFlip, Budget=1002026.05 | 29.1 | — | — | — | |
| TextBuggerVictim=HotFlip, Budget=1002026.05 | 29.3 | — | — | — | |
| BBAVictim=HotFlip, Budget=1002026.05 | 30 | — | — | — | |
| SEP-AttackVictim=ChatGPT2026.05 | 32.3 | — | — | — | |
| SEP-AttackVictim=HotFlip, Budget=102026.05 | 33.3 | — | — | — | |
| SEP-AttackVictim=Llama2026.05 | 38.7 | — | — | — | |
| BBAVictim=SHIELD, Budget=1002026.05 | 39.2 | — | — | — | |
| HQA-AttackVictim=SHIELD, Budget=1002026.05 | 41.6 | — | — | — | |
| SEP-AttackVictim=Mistral2026.05 | 41.6 | — | — | — | |
| SEP-AttackVictim=SHIELD, Budget=102026.05 | 47.1 | — | — | — | |
| BBABudget=1002026.05 | — | 40.5 | 44.3 | 49.2 | |
| DeepWordBugBudget=1002026.05 | — | 23.5 | 44.1 | 36.3 | |
| EnsembleBudget=102026.05 | — | 12.7 | 6.4 | 16.3 | |
| HAWRBudget=102026.05 | — | 22.4 | 23.5 | 22.2 | |
| HQA-AttackBudget=1002026.05 | — | 33 | 36.2 | 36.7 | |
| LeapAttackBudget=1002026.05 | — | 30.4 | 33.6 | 37.6 | |
| SEP-AttackBudget=102026.05 | — | 58.8 | 63.2 | 63.7 | |
| TextBuggerBudget=1002026.05 | — | 27.6 | 50.7 | 45.3 | |
| TextFoolerBudget=1002026.05 | — | 18.8 | 29.4 | 23.1 |