Adversarial Text Detection on YELP
97.4F1 ScoreVoteTRANS_same
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| VoteTRANS_sameTarget Model=BERT, Attack=PWWS, Auxiliary Attack=PWWS2023.06 | 97.4 | 98.4 | — | |
| VoteTRANS_sameTarget Model=BERT, Attack=TextFooler, Auxiliary Attack=TextFooler2023.06 | 97.4 | 98.8 | — | |
| VoteTRANS_diffTarget Model=BERT, Attack=TextFooler, Auxiliary Attack=PWWS2023.06 | 97 | 98 | — | |
| WDRModel=BERT, Attack=TextFooler2022.04 | 95.9 | — | 97.5 | |
| WDRTarget Model=BERT, Attack=TextFooler, Detector training configuration=(DistilBERT, AG News, PWWS)2023.06 | 95.4 | 94.7 | — | |
| WDRModel=BERT, Attack=TextFooler, Detector Trained On=DistilBERT, AG News, PWWS2022.04 | 95.4 | 94.7 | — | |
| FGWSTarget Model=BERT, Attack=PWWS, Detector training configuration=(DistilBERT, AG News, PWWS)2023.06 | 91.2 | 85.6 | — | |
| FGWSModel=BERT, Attack=PWWS, Detector Trained On=DistilBERT, AG News, PWWS2022.04 | 91.2 | 85.6 | — | |
| FGWSModel=BERT, Attack=PWWS2022.04 | 91.2 | — | 85.6 | |
| FGWSTarget Model=BERT, Attack=TextFooler, Detector training configuration=(DistilBERT, AG News, PWWS)2023.06 | 90.5 | 84.2 | — | |
| FGWSModel=BERT, Attack=TextFooler, Detector Trained On=DistilBERT, AG News, PWWS2022.04 | 90.5 | 84.2 | — | |
| FGWSModel=BERT, Attack=TextFooler2022.04 | 90.5 | — | 84.2 | |
| WDRModel=BERT, Attack=PWWS2022.04 | 89.4 | — | 85.3 | |
| WDRTarget Model=BERT, Attack=PWWS, Detector training configuration=(DistilBERT, AG News, PWWS)2023.06 | 86.2 | 77.2 | — | |
| WDRModel=BERT, Attack=PWWS, Detector Trained On=DistilBERT, AG News, PWWS2022.04 | 86.2 | 77.2 | — |