Topic Classification on AG's News (test) (Robustness Metrics)
100ASR (Badnet)w/o Defense
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| w/o DefenseBackbone=BERT-base, Defense Type=None (Training-time)2022.06 | 100 | 94.24 | 94.62 | 100 | 94.51 | 98.05 | 90.63 | 82.22 | 90.17 | |
| RAPBackbone=BERT-base, Defense Type=Training-time2022.06 | 100 | 25.11 | 94.07 | 100 | 94.51 | 99.19 | 91.03 | 76.51 | 90.59 | |
| STRIPBackbone=BERT-base, Defense Type=Training-time2022.06 | 99.93 | 94.42 | 93.93 | 100 | 94.55 | 99.16 | 89.97 | 81.64 | 91.03 | |
| ONIONBackbone=BERT-base, Defense Type=Training-time2022.06 | 98.91 | 93.92 | 93.21 | 100 | 94.03 | 93.37 | 90.11 | 80.12 | 89.49 | |
| BKIBackbone=BERT-base, Defense Type=Training-time2022.06 | 93.67 | 94.26 | 94.42 | 100 | 94.33 | 97 | 90.97 | 80.9 | 90.33 | |
| OracleBackbone=BERT-base, Defense Type=Training-time (Ideal)2022.06 | 0.89 | — | 94.24 | 0.54 | 94.21 | 4.96 | 91.17 | 5.01 | 91.08 | |
| CUBEBackbone=BERT-base, Defense Type=Training-time2022.06 | 0.72 | 93.92 | 94.12 | 0.58 | 94.55 | 5.72 | 87.59 | 4.71 | 87.38 |