Adversarial Attack on ImageNet-compatible Stable Diffusion context v1.4 (test)
99.9ASR (MN-v2)tAdv
Evaluation Results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tAdvSurrogate Model=MN-v22023.05 | 99.9 | 27.2 | 31.5 | 24.3 | 24.5 | 22.4 | 40.5 | 16.1 | 15.9 | 15.1 | 24.17 | |
| ACESurrogate Model=MN-v22023.05 | 99.1 | 9.5 | 17.9 | 12.4 | 12.6 | 11.7 | 16.3 | 12.1 | 5.4 | 5.6 | 11.5 | |
| ReColorAdvSurrogate Model=MN-v22023.05 | 97.7 | 18.6 | 33.7 | 24.7 | 26.4 | 20.7 | 31.8 | 17.7 | 12.2 | 12.6 | 22.04 | |
| cAdvSurrogate Model=MN-v22023.05 | 96.6 | 26.8 | 39.6 | 33.9 | 29.9 | 32.7 | 41.9 | 33.1 | 20.6 | 19.7 | 30.91 | |
| ColorFoolSurrogate Model=MN-v22023.05 | 93.3 | 9.5 | 25.7 | 15.3 | 15.4 | 13.4 | 15.7 | 14.2 | 5.9 | 6.4 | 13.5 | |
| NCFSurrogate Model=MN-v22023.05 | 93.2 | 33.6 | 65.9 | 43.5 | 56.3 | 33 | 52.6 | 35.8 | 21.2 | 20.6 | 40.28 | |
| ACASurrogate Model=MN-v22023.05 | 93.1 | 56.8 | 62.6 | 55.7 | 56 | 51 | 59.6 | 48.7 | 48.6 | 50.4 | 54.38 | |
| SAESurrogate Model=MN-v22023.05 | 90.8 | 22.5 | 53.2 | 38 | 41.9 | 26.9 | 44.6 | 33.6 | 16.8 | 18.3 | 32.87 | |
| NCFSurrogate Model=RN-502023.05 | 71.2 | 33.6 | 91.4 | 48.5 | 60.5 | 32.4 | 52.6 | 36.8 | 19.8 | 21.7 | 41.9 | |
| ACASurrogate Model=RN-502023.05 | 69.3 | 61.6 | 88.3 | 61.9 | 61.7 | 60.3 | 62.6 | 52.9 | 51.9 | 53.2 | 59.49 | |
| NCFSurrogate Model=MobViT-s2023.05 | 67.7 | 31.2 | 60.3 | 41.8 | 52.2 | 32.2 | 74.5 | 39.1 | 20.8 | 23.1 | 40.93 | |
| ACASurrogate Model=MobViT-s2023.05 | 66.2 | 56.6 | 60.6 | 58.1 | 55.9 | 55.5 | 89.8 | 51.4 | 52.7 | 55.1 | 56.9 | |
| ACASurrogate Model=ViT-B2023.05 | 64.6 | 58.8 | 60.2 | 58.1 | 58.1 | 57.1 | 60.8 | 87.7 | 55.5 | 54.9 | 58.68 | |
| SAESurrogate Model=RN-502023.05 | 63.2 | 25.9 | 88 | 41.9 | 46.5 | 28.8 | 45.9 | 35.3 | 20.3 | 19.6 | 36.38 | |
| SAESurrogate Model=MobViT-s2023.05 | 60.2 | 21.2 | 54.6 | 42.7 | 44.9 | 30.2 | 82.5 | 38.6 | 21.1 | 20.2 | 37.08 | |
| ADerSurrogate Model=MN-v22023.05 | 56.6 | 7.6 | 8.4 | 7.7 | 7.1 | 10.9 | 11.7 | 9.5 | 4.5 | 4.5 | 7.99 | |
| NCFSurrogate Model=ViT-B2023.05 | 55.9 | 25.3 | 50.6 | 34.8 | 42.3 | 29.9 | 40.6 | 81 | 20 | 19.1 | 35.39 | |
| SAESurrogate Model=ViT-B2023.05 | 54.5 | 26.9 | 49.7 | 38.4 | 41.4 | 30.4 | 46.1 | 78.4 | 19.9 | 18.1 | 36.16 | |
| ColorFoolSurrogate Model=MobViT-s2023.05 | 47.1 | 12 | 40 | 28.1 | 30.7 | 19.3 | 81.7 | 24.3 | 9.7 | 10 | 24.58 | |
| ColorFoolSurrogate Model=ViT-B2023.05 | 45.3 | 13.9 | 35.7 | 24.3 | 28.8 | 19.8 | 27 | 83.1 | 8.9 | 9.3 | 23.67 | |
| cAdvSurrogate Model=RN-502023.05 | 44.2 | 25.3 | 97.2 | 36.8 | 37 | 34.9 | 40.1 | 30.6 | 19.3 | 20.2 | 32.04 | |
| tAdvSurrogate Model=RN-502023.05 | 43.4 | 27 | 99 | 28.8 | 30.2 | 21.6 | 35.9 | 16.5 | 15.2 | 15.1 | 25.97 | |
| cAdvSurrogate Model=MobViT-s2023.05 | 41.9 | 25.4 | 33.2 | 31.2 | 28.2 | 34.7 | 84.3 | 32.6 | 22.7 | 22 | 30.21 | |
| ColorFoolSurrogate Model=RN-502023.05 | 41.6 | 9.8 | 90.1 | 18.6 | 21 | 15.4 | 20.4 | 15.4 | 5.9 | 6.8 | 17.21 | |
| ReColorAdvSurrogate Model=RN-502023.05 | 40.6 | 17.7 | 96.4 | 28.3 | 33.3 | 19.2 | 29.3 | 18.8 | 12.9 | 13.4 | 23.72 | |
| tAdvSurrogate Model=ViT-B2023.05 | 39.5 | 22.8 | 25.8 | 23.2 | 22.3 | 20.8 | 34.1 | 93.5 | 16.3 | 15.3 | 24.46 | |
| ReColorAdvSurrogate Model=MobViT-s2023.05 | 37.4 | 14.7 | 26.7 | 22.4 | 21 | 20.8 | 96.1 | 21.5 | 16.3 | 16.7 | 21.94 | |
| tAdvSurrogate Model=MobViT-s2023.05 | 33.6 | 18.8 | 22.1 | 18.7 | 18.7 | 15.8 | 97.4 | 15.3 | 11.2 | 13.7 | 18.66 | |
| ACESurrogate Model=RN-502023.05 | 32.8 | 9.4 | 99.1 | 16.1 | 15.2 | 12.7 | 20.5 | 13.1 | 6.1 | 5.3 | 14.58 | |
| cAdvSurrogate Model=ViT-B2023.05 | 31.4 | 27 | 26.1 | 22.5 | 19.9 | 26.1 | 32.9 | 96.5 | 18.4 | 16.9 | 24.58 | |
| ACESurrogate Model=ViT-B2023.05 | 30.9 | 11.4 | 22 | 15.5 | 15.2 | 13 | 17 | 98.6 | 6.5 | 6.3 | 15.31 | |
| ACESurrogate Model=MobViT-s2023.05 | 30.7 | 9.7 | 20.3 | 16.3 | 14.4 | 13.8 | 99.2 | 16.5 | 6.8 | 5.8 | 14.92 | |
| ReColorAdvSurrogate Model=ViT-B2023.05 | 25.5 | 12.1 | 17.5 | 13.9 | 14.4 | 15.4 | 22.9 | 97.7 | 10.9 | 8.6 | 15.69 | |
| ADerSurrogate Model=RN-502023.05 | 15.5 | 7.7 | 55.7 | 8.4 | 7.8 | 11.4 | 12.3 | 9.2 | 4.6 | 4.9 | 9.09 | |
| ADerSurrogate Model=ViT-B2023.05 | 15.3 | 8.3 | 9.9 | 8.4 | 7.6 | 12 | 12.4 | 81.5 | 5.3 | 5.5 | 9.41 | |
| ADefSurrogate Model=MobViT-s2023.05 | 14.5 | 6.6 | 9 | 8 | 7.1 | 9.8 | 80.8 | 9.7 | 5.1 | 4.6 | 8.27 | |
| ILMSurrogate Model=N/A2023.05 | 13.5 | 5.5 | 8 | 6.3 | 5.9 | 8.3 | 8.3 | 9 | 4.8 | 4 | 7.36 | |
| CleanSurrogate Model=N/A2023.05 | 12.1 | 4.8 | 7 | 6.3 | 5.6 | 8.7 | 7.8 | 8.9 | 3.5 | 3.6 | 6.83 |