Text Classification on AG NEWS (test) (RoBERTa-large)
95.6CACCDARE
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| DAREBackbone=RoBERTa-large, Attack Scenario=Combined: BadNet + InsertSent2025.04 | 95.6 | 33.7 | 66.6 | — | — | 50.1 | |
| DAREBackbone=RoBERTa-large, Attack Scenario=Combined: Benign + BadNet2025.04 | 95.6 | 33.6 | — | — | — | 33.6 | |
| DAREBackbone=RoBERTa-large, Attack Scenario=Combined: Benign + LWS2025.04 | 95.6 | — | — | 2.6 | — | 2.6 | |
| DAREBackbone=RoBERTa-large, Attack Scenario=Combined: Benign + InsertSent2025.04 | 95.6 | — | 3.1 | — | — | 3.1 | |
| DAREBackbone=RoBERTa-large, Attack Scenario=Combined: InsertSent + Hidden2025.04 | 95.5 | — | 84 | — | 15.8 | 49.9 | |
| DAREBackbone=RoBERTa-large, Attack Scenario=Combined: Benign + Hidden2025.04 | 95.5 | — | — | — | 7.4 | 7.4 | |
| BenignBackbone=RoBERTa-large2025.04 | 95.4 | 1.9 | 0.5 | 0.5 | 1.1 | 1 | |
| Z-DefBackbone=RoBERTa-large2025.04 | 95.4 | 1.6 | 0.4 | 97.9 | 100 | 50 | |
| WAGBackbone=RoBERTa-large, Attack Scenario=Combined: BadNet + InsertSent2025.04 | 95.4 | 75.2 | 60.2 | — | — | 67.7 | |
| DAREBackbone=RoBERTa-large, Attack Scenario=Combined: InsertSent + LWS2025.04 | 95.4 | — | 99.6 | 1.2 | — | 50.4 | |
| DAREBackbone=RoBERTa-large, Attack Scenario=Combined: BadNet + LWS2025.04 | 95.4 | 99.3 | — | 3.5 | — | 51.4 | |
| WAGBackbone=RoBERTa-large, Attack Scenario=Combined: InsertSent + Hidden2025.04 | 95.4 | — | 61.4 | — | 43.6 | 52.5 | |
| DAREBackbone=RoBERTa-large, Attack Scenario=Combined: BadNet + Hidden2025.04 | 95.4 | 66.7 | — | — | 40.4 | 53.6 | |
| WAGBackbone=RoBERTa-large, Attack Scenario=Combined: Benign + BadNet2025.04 | 95.4 | 65.4 | — | — | — | 65.4 | |
| TIESBackbone=RoBERTa-large, Attack Scenario=Combined: Benign + BadNet2025.04 | 95.4 | 87.4 | — | — | — | 87.4 | |
| MSDBackbone=RoBERTa-large, Attack Scenario=Combined: Benign + BadNet2025.04 | 95.4 | 46.4 | — | — | — | 46.4 | |
| WAGBackbone=RoBERTa-large, Attack Scenario=Combined: Benign + InsertSent2025.04 | 95.4 | — | 56.6 | — | — | 56.6 | |
| TIESBackbone=RoBERTa-large, Attack Scenario=Combined: BadNet + InsertSent2025.04 | 95.3 | 92.4 | 95.6 | — | — | 94 | |
| MSDBackbone=RoBERTa-large, Attack Scenario=Combined: BadNet + InsertSent2025.04 | 95.3 | 72.3 | 42.5 | — | — | 57.4 | |
| TIESBackbone=RoBERTa-large, Attack Scenario=Combined: InsertSent + Hidden2025.04 | 95.3 | — | 93.4 | — | 75.3 | 84.4 | |
| MSDBackbone=RoBERTa-large, Attack Scenario=Combined: InsertSent + Hidden2025.04 | 95.3 | — | 41.7 | — | 47.5 | 44.6 | |
| TIESBackbone=RoBERTa-large, Attack Scenario=Combined: BadNet + Hidden2025.04 | 95.3 | 91.9 | — | — | 71.9 | 81.9 | |
| DAREBackbone=RoBERTa-large, Attack Scenario=Combined: LWS + Hidden2025.04 | 95.3 | — | — | 2.5 | 99.9 | 51.2 | |
| TIESBackbone=RoBERTa-large, Attack Scenario=Combined: Benign + InsertSent2025.04 | 95.3 | — | 93.2 | — | — | 93.2 | |
| MSDBackbone=RoBERTa-large, Attack Scenario=Combined: Benign + InsertSent2025.04 | 95.3 | — | 16.6 | — | — | 16.6 | |
| WAGBackbone=RoBERTa-large, Attack Scenario=Combined: Benign + Hidden2025.04 | 95.3 | — | — | — | 36.4 | 36.4 | |
| TIESBackbone=RoBERTa-large, Attack Scenario=Combined: Benign + Hidden2025.04 | 95.3 | — | — | — | 68.8 | 68.8 | |
| MSDBackbone=RoBERTa-large, Attack Scenario=Combined: Benign + Hidden2025.04 | 95.3 | — | — | — | 48 | 48 | |
| WAGBackbone=RoBERTa-large, Attack Scenario=Combined: InsertSent + LWS2025.04 | 95.2 | — | 39.5 | 17.8 | — | 28.7 | |
| WAGBackbone=RoBERTa-large, Attack Scenario=Combined: BadNet + LWS2025.04 | 95.2 | 76.1 | — | 28.1 | — | 52.1 | |
| MSDBackbone=RoBERTa-large, Attack Scenario=Combined: BadNet + LWS2025.04 | 95.2 | 75.8 | — | 26 | — | 50.9 | |
| WAGBackbone=RoBERTa-large, Attack Scenario=Combined: BadNet + Hidden2025.04 | 95.2 | 73.2 | — | — | 37.2 | 55.2 | |
| MSDBackbone=RoBERTa-large, Attack Scenario=Combined: BadNet + Hidden2025.04 | 95.2 | 56.5 | — | — | 38.1 | 47.3 | |
| MSDBackbone=RoBERTa-large, Attack Scenario=Combined: LWS + Hidden2025.04 | 95.2 | — | — | 33.5 | 60.5 | 47 | |
| WAGBackbone=RoBERTa-large, Attack Scenario=Combined: Benign + LWS2025.04 | 95.2 | — | — | 14 | — | 14 | |
| TIESBackbone=RoBERTa-large, Attack Scenario=Combined: Benign + LWS2025.04 | 95.2 | — | — | 47.1 | — | 47.1 | |
| MSDBackbone=RoBERTa-large, Attack Scenario=Combined: Benign + LWS2025.04 | 95.2 | — | — | 15.7 | — | 15.7 | |
| TIESBackbone=RoBERTa-large, Attack Scenario=Combined: InsertSent + LWS2025.04 | 95.1 | — | 90.5 | 55.7 | — | 73.1 | |
| MSDBackbone=RoBERTa-large, Attack Scenario=Combined: InsertSent + LWS2025.04 | 95.1 | — | 9.5 | 16.7 | — | 13.1 | |
| TIESBackbone=RoBERTa-large, Attack Scenario=Combined: BadNet + LWS2025.04 | 95.1 | 95.6 | — | 64.4 | — | 80 | |
| WAGBackbone=RoBERTa-large, Attack Scenario=Combined: LWS + Hidden2025.04 | 95.1 | — | — | 31.7 | 62.6 | 47.2 | |
| TIESBackbone=RoBERTa-large, Attack Scenario=Combined: LWS + Hidden2025.04 | 95.1 | — | — | 67.5 | 92.2 | 79.9 | |
| VictimBackbone=RoBERTa-large2025.04 | 95 | 99.9 | 99.6 | 99.6 | 100 | 99.8 | |
| ONIONBackbone=RoBERTa-large2025.04 | 92.3 | 59.4 | 97.8 | 84.8 | 99.6 | 85.4 |