Adversarial Attack on ImageNet ILSVRC2012 (val)
100Robust Accuracy (Inception v3)TIM
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| TIMSurrogate Model=Inc-v3, Attack Setting=single model2023.08 | 100 | 49.3 | 43.9 | 40.2 | 24.6 | 21.7 | 13.4 | — | — | — | — | — | — | — | |
| SIMSurrogate Model=Inc-v3, Attack Setting=single model2023.08 | 100 | 69.5 | 68.5 | 63.5 | 32.3 | 31 | 17.4 | — | — | — | — | — | — | — | |
| AdmixSurrogate Model=Inc-v3, Attack Setting=single model2023.08 | 100 | 82.2 | 81.1 | 73.8 | 38.7 | 37.9 | 19.8 | — | — | — | — | — | — | — | |
| PAMSurrogate Model=Inc-v3, Attack Setting=single model2023.08 | 100 | 76.4 | 75.5 | 69.6 | 39 | 38.8 | 20 | — | — | — | — | — | — | — | |
| BSRSurrogate Model=Inc-v3, Attack Setting=single model2023.08 | 100 | 96.2 | 94.7 | 90.5 | 55 | 51.6 | 29.3 | — | — | — | — | — | — | — | |
| DIMSurrogate Model=Inc-v3, Attack Setting=single model2023.08 | 98.6 | 64.4 | 60.2 | 53.5 | 18.8 | 18.4 | 9.5 | — | — | — | — | — | — | — | |
| BSRSurrogate Model=Res-101, Attack Setting=single model2023.08 | 97.1 | 96.6 | 96.6 | 99.7 | 78.7 | 74.7 | 55.6 | — | — | — | — | — | — | — | |
| BSRSurrogate Model=Inc-v4, Attack Setting=single model2023.08 | 96.1 | 99.9 | 93.4 | 88.4 | 57.6 | 52.1 | 34.3 | — | — | — | — | — | — | — | |
| BSRSurrogate Model=IncRes-v2, Attack Setting=single model2023.08 | 94.6 | 93.8 | 98.5 | 90.7 | 71.4 | 63.1 | 51 | — | — | — | — | — | — | — | |
| AdmixSurrogate Model=IncRes-v2, Attack Setting=single model2023.08 | 90.8 | 86.3 | 99.2 | 82.2 | 63.6 | 56.6 | 49.4 | — | — | — | — | — | — | — | |
| AdmixSurrogate Model=Inc-v4, Attack Setting=single model2023.08 | 89 | 99.9 | 85.3 | 79 | 55.5 | 51.7 | 32.3 | — | — | — | — | — | — | — | |
| PAMSurrogate Model=IncRes-v2, Attack Setting=single model2023.08 | 88.6 | 86.3 | 99.4 | 81.6 | 66 | 58.3 | 51 | — | — | — | — | — | — | — | |
| PAMSurrogate Model=Inc-v4, Attack Setting=single model2023.08 | 86.7 | 99.9 | 81.6 | 75.9 | 55.4 | 50.5 | 33.2 | — | — | — | — | — | — | — | |
| SIMSurrogate Model=IncRes-v2, Attack Setting=single model2023.08 | 85.9 | 80 | 98.7 | 76.1 | 56.2 | 49.1 | 42.5 | — | — | — | — | — | — | — | |
| AdmixSurrogate Model=Res-101, Attack Setting=single model2023.08 | 84.5 | 80.2 | 80.7 | 99.9 | 51.6 | 44.7 | 29.9 | — | — | — | — | — | — | — | |
| SIMSurrogate Model=Inc-v4, Attack Setting=single model2023.08 | 80.4 | 99.7 | 73.4 | 69.4 | 48.6 | 45.2 | 29.6 | — | — | — | — | — | — | — | |
| PAMSurrogate Model=Res-101, Attack Setting=single model2023.08 | 77.4 | 73.9 | 75.7 | 99.9 | 51.2 | 46.3 | 32.2 | — | — | — | — | — | — | — | |
| DIMSurrogate Model=Res-101, Attack Setting=single model2023.08 | 76 | 68.4 | 70.3 | 98 | 34.7 | 31.8 | 19.6 | — | — | — | — | — | — | — | |
| SIMSurrogate Model=Res-101, Attack Setting=single model2023.08 | 74.1 | 69.6 | 69.1 | 99.7 | 42.8 | 39.6 | 25.7 | — | — | — | — | — | — | — | |
| DIMSurrogate Model=Inc-v4, Attack Setting=single model2023.08 | 72 | 97.6 | 63.8 | 57.2 | 22.6 | 21.1 | 11.7 | — | — | — | — | — | — | — | |
| DIMSurrogate Model=IncRes-v2, Attack Setting=single model2023.08 | 70.3 | 64.7 | 93.1 | 58 | 30.4 | 23.5 | 16.9 | — | — | — | — | — | — | — | |
| TIMSurrogate Model=IncRes-v2, Attack Setting=single model2023.08 | 62.2 | 55.6 | 97.4 | 50.3 | 32.4 | 27.5 | 22.6 | — | — | — | — | — | — | — | |
| TIMSurrogate Model=Res-101, Attack Setting=single model2023.08 | 59.9 | 52.2 | 51.9 | 99.2 | 34.4 | 31.2 | 23.7 | — | — | — | — | — | — | — | |
| TIMSurrogate Model=Inc-v4, Attack Setting=single model2023.08 | 59.1 | 99.7 | 49 | 41.9 | 26.8 | 22.9 | 16.6 | — | — | — | — | — | — | — | |
| MI-FGSMSource Model=Inc-v32021.03 | — | — | — | — | — | — | — | 100 | 43.6 | 42.4 | 35.7 | 13.1 | 12.8 | 6.2 | |
| MI-FGSMSource Model=Inc-v42021.03 | — | — | — | — | — | — | — | 56.3 | 99.7 | 46.6 | 41 | 16.3 | 14.8 | 7.5 | |
| MI-FGSMSource Model=IncRes-v22021.03 | — | — | — | — | — | — | — | 60.7 | 51.1 | 97.9 | 46.8 | 21.2 | 16 | 11.9 | |
| MI-FGSMSource Model=Res-1012021.03 | — | — | — | — | — | — | — | 58.1 | 51.6 | 50.5 | 99.3 | 23.9 | 21.5 | 12.7 | |
| NI-FGSMSource Model=Inc-v32021.03 | — | — | — | — | — | — | — | 100 | 51.7 | 50.3 | 41.3 | 13.5 | 13.2 | 6 | |
| NI-FGSMSource Model=Inc-v42021.03 | — | — | — | — | — | — | — | 63.1 | 100 | 51.8 | 45.8 | 15.4 | 13.6 | 6.7 | |
| NI-FGSMSource Model=IncRes-v22021.03 | — | — | — | — | — | — | — | 62.8 | 54.7 | 99.1 | 46 | 20 | 15.1 | 9.6 | |
| NI-FGSMSource Model=Res-1012021.03 | — | — | — | — | — | — | — | 65.6 | 58.3 | 57 | 99.4 | 24.5 | 21.4 | 11.7 | |
| VMI-FGSMSource Model=Inc-v32021.03 | — | — | — | — | — | — | — | 100 | 71.7 | 68.1 | 60.2 | 32.8 | 31.2 | 17.5 | |
| VMI-FGSMSource Model=Inc-v42021.03 | — | — | — | — | — | — | — | 77.9 | 99.8 | 71.2 | 62.2 | 38.2 | 38.7 | 23.2 | |
| VMI-FGSMSource Model=IncRes-v22021.03 | — | — | — | — | — | — | — | 77.9 | 72.1 | 97.9 | 67.7 | 46.4 | 40.8 | 34.4 | |
| VMI-FGSMSource Model=Res-1012021.03 | — | — | — | — | — | — | — | 75.1 | 68.9 | 70.5 | 99.2 | 45.2 | 41.4 | 30.1 | |
| VNI-FGSMSource Model=Inc-v32021.03 | — | — | — | — | — | — | — | 100 | 76.5 | 74.9 | 66 | 35 | 32.8 | 18.8 | |
| VNI-FGSMSource Model=Inc-v42021.03 | — | — | — | — | — | — | — | 83.4 | 99.9 | 76.1 | 66.9 | 40 | 37.7 | 24.5 | |
| VNI-FGSMSource Model=IncRes-v22021.03 | — | — | — | — | — | — | — | 80.8 | 76.9 | 98.5 | 69.8 | 47.9 | 40.3 | 34.2 | |
| VNI-FGSMSource Model=Res-1012021.03 | — | — | — | — | — | — | — | 79.8 | 74.6 | 73.2 | 99.7 | 46.1 | 42.5 | 32.1 |