Untargeted Adversarial Attack on ImageNet (test)
72.1ASR (Inc-v3)TGR
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| TGRSource Model=PiT-B2023.03 | 72.1 | — | — | — | 69.8 | 65.1 | 64.8 | 43.6 | 41.5 | 32.8 | — | — | — | — | — | |
| TGRSource Model=Visformer-S2023.03 | 65.9 | — | — | — | 66.8 | 55.3 | 60.9 | 36 | 32.5 | 23.3 | — | — | — | — | — | |
| TGRSource Model=CaiT-S/242023.03 | 60.3 | — | — | — | 52.9 | 49.3 | 53.4 | 39.6 | 37 | 31.8 | — | — | — | — | — | |
| PNASource Model=PiT-B2023.03 | 59.3 | — | — | — | 56.3 | 49.8 | 53 | 33.3 | 32 | 25.5 | — | — | — | — | — | |
| VMISource Model=CaiT-S/242023.03 | 58.5 | — | — | — | 50.9 | 48.2 | 52 | 38.1 | 36.1 | 30.1 | — | — | — | — | — | |
| PNASource Model=CaiT-S/242023.03 | 57.2 | — | — | — | 51.8 | 47.7 | 51.6 | 38.4 | 36.2 | 30.1 | — | — | — | — | — | |
| PNASource Model=Visformer-S2023.03 | 55.9 | — | — | — | 54.6 | 46 | 51.7 | 29.3 | 26.2 | 21.1 | — | — | — | — | — | |
| VMISource Model=Visformer-S2023.03 | 54.6 | — | — | — | 53.2 | 48.5 | 52.2 | 33 | 32 | 22.2 | — | — | — | — | — | |
| SGMSource Model=CaiT-S/242023.03 | 53.5 | — | — | — | 45.9 | 40.2 | 45.9 | 30.8 | 28.5 | 21 | — | — | — | — | — | |
| SGMSource Model=PiT-B2023.03 | 50.6 | — | — | — | 45.4 | 38.4 | 41.9 | 25.6 | 20.8 | 16.7 | — | — | — | — | — | |
| MIMSource Model=CaiT-S/242023.03 | 48.4 | — | — | — | 42.9 | 39.5 | 43.8 | 30.8 | 27.6 | 23.3 | — | — | — | — | — | |
| TGRSource Model=ViT-B/162023.03 | 47.5 | — | — | — | 42.3 | 37.6 | 43.3 | 31.5 | 30.8 | 25.6 | — | — | — | — | — | |
| VMISource Model=PiT-B2023.03 | 47.3 | — | — | — | 45.4 | 40.7 | 43.4 | 35.9 | 34.4 | 29.7 | — | — | — | — | — | |
| MIMSource Model=Visformer-S2023.03 | 44.5 | — | — | — | 42.5 | 36.6 | 39.6 | 24.4 | 20.5 | 16.6 | — | — | — | — | — | |
| SGMSource Model=Visformer-S2023.03 | 43.2 | — | — | — | 41.1 | 29.6 | 35.7 | 16.1 | 13 | 8.2 | — | — | — | — | — | |
| VMISource Model=ViT-B/162023.03 | 43.1 | — | — | — | 41.6 | 37.9 | 42.6 | 31.4 | 30.6 | 25 | — | — | — | — | — | |
| PNASource Model=ViT-B/162023.03 | 42.7 | — | — | — | 37.5 | 35.3 | 39.5 | 29 | 27.3 | 22.6 | — | — | — | — | — | |
| MIMSource Model=PiT-B2023.03 | 36.3 | — | — | — | 34.8 | 27.4 | 29.6 | 19 | 18.3 | 14.1 | — | — | — | — | — | |
| MIMSource Model=ViT-B/162023.03 | 31.7 | — | — | — | 28.6 | 26.1 | 29.4 | 22.3 | 19.8 | 16.5 | — | — | — | — | — | |
| SGMSource Model=ViT-B/162023.03 | 31.5 | — | — | — | 27.7 | 23.8 | 28.2 | 20.8 | 18 | 14.3 | — | — | — | — | — | |
| MTDAI+RAP-LSDefense=NRP, Attack Type=Ensemble2022.10 | 24.9 | 15.6 | 15.3 | 26.1 | — | — | — | — | — | — | — | — | — | — | — | |
| MTDSI+RAP-LSDefense=NRP, Attack Type=Ensemble2022.10 | 24.5 | 15.3 | 15.4 | 26.2 | — | — | — | — | — | — | — | — | — | — | — | |
| MTDAIDefense=NRP, Attack Type=Ensemble2022.10 | 24.1 | 14.7 | 14.2 | 25.9 | — | — | — | — | — | — | — | — | — | — | — | |
| MTDIDefense=NRP, Attack Type=Ensemble2022.10 | 23.1 | 13.5 | 14.2 | 25.7 | — | — | — | — | — | — | — | — | — | — | — | |
| MTDI+RAP-LSDefense=NRP, Attack Type=Ensemble2022.10 | 22.7 | 14.8 | 14.9 | 26.3 | — | — | — | — | — | — | — | — | — | — | — | |
| MTDSIDefense=NRP, Attack Type=Ensemble2022.10 | 22.5 | 14.2 | 15 | 26.1 | — | — | — | — | — | — | — | — | — | — | — | |
| BASESScenario=Query w/ surrogate2024.06 | — | — | — | — | — | — | — | — | — | — | 0 | 58.5 | 32.6 | 8.6 | 24.9 | |
| Dif++closeScenario=Query w/ surrogate2024.06 | — | — | — | — | — | — | — | — | — | — | 71 | 92 | 43.5 | 69.5 | 69 | |
| Dif++openScenario=Query w/o surrogate2024.06 | — | — | — | — | — | — | — | — | — | — | 64.5 | 88.8 | 45.4 | 40.4 | 43.7 | |
| DifAttackScenario=Query w/o surrogate2024.06 | — | — | — | — | — | — | — | — | — | — | 52.5 | 46.5 | 41.5 | 28.5 | 42.3 | |
| GFCSScenario=Query w/ surrogate2024.06 | — | — | — | — | — | — | — | — | — | — | 6.8 | 21.5 | 32.9 | 22.5 | 20.9 | |
| MCGSquareScenario=Query w/ surrogate2024.06 | — | — | — | — | — | — | — | — | — | — | 70.5 | 72 | 34.5 | 65.5 | 60 | |
| N AttackScenario=Query w/o surrogate2024.06 | — | — | — | — | — | — | — | — | — | — | 39.2 | 45 | 34.9 | 24 | 35.8 | |
| NESScenario=Query w/o surrogate2024.06 | — | — | — | — | — | — | — | — | — | — | 18.6 | 21 | 31.3 | 20 | 22.7 | |
| P-RGFScenario=Query w/ surrogate2024.06 | — | — | — | — | — | — | — | — | — | — | 43.2 | 38 | 38.5 | 30.4 | 37.5 | |
| SignHScenario=Query w/o surrogate2024.06 | — | — | — | — | — | — | — | — | — | — | 36.7 | 38 | 28.9 | 12.6 | 29.1 | |
| SimBAScenario=Query w/o surrogate2024.06 | — | — | — | — | — | — | — | — | — | — | 39.5 | 14.5 | 37.2 | 13.1 | 26 | |
| SubspaceScenario=Query w/ surrogate2024.06 | — | — | — | — | — | — | — | — | — | — | 54.8 | 54 | 31.2 | 14.8 | 38.7 |