Adversarial Text Detection on AG News (test)
95.5F1 ScoreVoteTRANS
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| VoteTRANSTarget Model=LSTM, Attack=PWWS, Auxiliary attack=Same2023.06 | 95.5 | 98.4 | |
| VoteTRANSTarget Model=DistilBERT, Attack=PWWS, Auxiliary attack=Same2023.06 | 95.3 | 97.6 | |
| WDRTarget Model=LSTM, Attack=PWWS, Detector training configuration=DistilBERT, AG News, PWWS2023.06 | 94 | 94.2 | |
| WDRTarget Model=DistilBERT, Attack=PWWS, Detector training configuration=DistilBERT, AG News, PWWS2023.06 | 93.6 | 94.8 | |
| FGWSTarget Model=DistilBERT, Attack=PWWS, Detector training configuration=DistilBERT, AG News, PWWS2023.06 | 89.5 | 84.6 | |
| FGWSTarget Model=LSTM, Attack=PWWS, Detector training configuration=DistilBERT, AG News, PWWS2023.06 | 88.9 | 84.9 |