Adversarial Attack on IMDB (test)
100Success RateNo Detector
Evaluation Results
| Method | Links | |
|---|---|---|
| No DetectorConfiguration=Without detector, Attack=Adaptive (PWWS), Target Model=CNN2023.06 | 100 | |
| SEP-AttackVictim=SHIELD, Budget=102026.05 | 97.9 | |
| SEP-AttackVictim=HotFlip, Budget=102026.05 | 85.4 | |
| BBAVictim=HotFlip, Budget=1002026.05 | 45.2 | |
| BBAVictim=SHIELD, Budget=1002026.05 | 37.8 | |
| EnsembleVictim=SHIELD, Budget=102026.05 | 30.5 | |
| HAWRVictim=HotFlip, Budget=102026.05 | 24.8 | |
| HQA-AttackVictim=SHIELD, Budget=1002026.05 | 24.4 | |
| HQA-AttackVictim=HotFlip, Budget=1002026.05 | 24.3 | |
| HAWRVictim=SHIELD, Budget=102026.05 | 23.9 | |
| LeapAttackVictim=HotFlip, Budget=1002026.05 | 23.2 | |
| DeepWordBugVictim=HotFlip, Budget=1002026.05 | 22.3 | |
| EnsembleVictim=HotFlip, Budget=102026.05 | 21.7 | |
| LeapAttackVictim=SHIELD, Budget=1002026.05 | 19 | |
| WDRConfiguration=With WDR, Attack=Adaptive (PWWS), Target Model=CNN2023.06 | 16.4 | |
| TextBuggerVictim=HotFlip, Budget=1002026.05 | 14.5 | |
| TextFoolerVictim=HotFlip, Budget=1002026.05 | 7.6 | |
| DeepWordBugVictim=SHIELD, Budget=1002026.05 | 4.75 | |
| TextBuggerVictim=SHIELD, Budget=1002026.05 | 4.54 | |
| VoteTRANSConfiguration=With VoteTRANS, Attack=Adaptive (PWWS), Target Model=CNN2023.06 | 4.3 | |
| TextFoolerVictim=SHIELD, Budget=1002026.05 | 4.1 |