Topic Classification on AG NEWS (test) (Adversarial Robustness)
95.2Clean AccuracyTAVAT
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| TAVAT2023.06 | 95.2 | 31.8 | 66.5 | 369.9 | 35 | 62.5 | 634.9 | 54.2 | 43.9 | 231.2 | |
| FreeLB++method_category=SOTA defense2023.06 | 94.9 | 51.5 | 46 | 439.1 | 41.8 | 56.2 | 676.4 | 55.9 | 41.4 | 265.4 | |
| Flooding-Xtraining_type=adversarial training2023.06 | 94.8 | 42.4 | 54.9 | 421.4 | 27.4 | 71 | 590.3 | 62.2 | 34 | 272.5 | |
| FreeLBtraining_type=adversarial training2023.06 | 94.7 | 34.8 | 63.4 | 408.5 | 20.4 | 73.8 | 596.2 | 54.2 | 43 | 210.3 | |
| PGDtraining_type=adversarial training2023.06 | 94.5 | 36.8 | 68.2 | 414.9 | 21.6 | 77.1 | 616.1 | 56.4 | 41.9 | 201.8 | |
| InfoBERTmethod_category=SOTA defense2023.06 | 94.5 | 33.8 | 65.1 | 395.6 | 23.4 | 75.3 | 618.9 | 49.6 | 47.7 | 194.1 | |
| Fine-tune2023.06 | 93.9 | 28.6 | 69.9 | 383.3 | 17.6 | 81.2 | 556 | 45.2 | 53.4 | 192.5 | |
| DSRM2023.06 | 93.5 | 62.9 | 31.4 | 495 | 58.6 | 36.1 | 797.7 | 69.4 | 24.8 | 294.6 |