Adversarial Detection on RTMR
78.9F1 ScoreFGWS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FGWSModel=DistilBERT, Attack=PWWS, Detector Trained On=DistilBERT, AG News, PWWS2022.04 | 78.9 | 67.8 | |
| FGWSModel=DistilBERT, Attack=PWWS2022.04 | 78.9 | 67.8 | |
| WDRModel=DistilBERT, Attack=PWWS, Detector Trained On=DistilBERT, AG News, PWWS2022.04 | 75.8 | 78.5 | |
| WDRModel=DistilBERT, Attack=PWWS2022.04 | 74.1 | 85.1 | |
| WDRModel=DistilBERT, Attack=IGA, Detector Trained On=DistilBERT, AG News, PWWS2022.04 | 73.7 | 85.4 | |
| WDRModel=DistilBERT, Attack=BAE, Detector Trained On=DistilBERT, AG News, PWWS2022.04 | 71 | 75.2 | |
| WDRModel=DistilBERT, Attack=IGA2022.04 | 70.4 | 90.2 | |
| WDRModel=DistilBERT, Attack=BAE2022.04 | 68.5 | 82.2 | |
| FGWSModel=DistilBERT, Attack=IGA, Detector Trained On=DistilBERT, AG News, PWWS2022.04 | 68.1 | 55.2 | |
| FGWSModel=DistilBERT, Attack=IGA2022.04 | 68.1 | 55.2 | |
| FGWSModel=DistilBERT, Attack=BAE, Detector Trained On=DistilBERT, AG News, PWWS2022.04 | 29.4 | 18.5 | |
| FGWSModel=DistilBERT, Attack=BAE2022.04 | 29.4 | 18.5 |