Adversarial Robustness Evaluation on Mini-ImageNet
88.09FGSM AccuracyMAPE
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| MAPETarget Model=ViT-S/16, Substitute Model=ResNet-V2-502026.06 | 88.09 | 89.38 | 86.64 | 86.68 | 87.45 | 87.43 | |
| LDTTarget Model=ViT-S/16, Substitute Model=ResNet-V2-502026.06 | 86.8 | 87.19 | 84.33 | 84.18 | 85.3 | 85.58 | |
| MAPETarget Model=ViT-S/16, Substitute Model=ShuffleNet-V2-2x2026.06 | 86.45 | 89.38 | 85.73 | 85.47 | 86.04 | 86.07 | |
| LDTTarget Model=ViT-S/16, Substitute Model=ShuffleNet-V2-2x2026.06 | 84.97 | 87.19 | 83.32 | 82.42 | 83.39 | 83.68 | |
| HGDTarget Model=ViT-S/16, Substitute Model=ResNet-V2-502026.06 | 82.16 | 84.36 | 81.55 | 80.11 | 81.06 | 81.43 | |
| HGDTarget Model=ViT-S/16, Substitute Model=ShuffleNet-V2-2x2026.06 | 80.04 | 84.36 | 79.74 | 78.03 | 79.57 | 79.89 | |
| Nat. Tra.Target Model=ViT-S/16, Substitute Model=ResNet-V2-502026.06 | 73.45 | 90.53 | 76.28 | 71.03 | 59.88 | 60.38 | |
| Nat. Tra.Target Model=ViT-S/16, Substitute Model=ShuffleNet-V2-2x2026.06 | 68.77 | 90.53 | 69.18 | 63 | 52.3 | 50.86 | |
| MAPETarget Model=VGG-19, Substitute Model=ResNet-V2-502026.06 | 68.44 | 69.27 | 66.47 | 66.68 | 67.52 | 67.15 | |
| LDTTarget Model=VGG-19, Substitute Model=ResNet-V2-502026.06 | 66.71 | 65.82 | 62.91 | 63.32 | 64.93 | 65.11 | |
| MAPETarget Model=VGG-19, Substitute Model=ShuffleNet-V2-2x2026.06 | 64.59 | 69.27 | 65.19 | 64.73 | 65.11 | 64.99 | |
| LDTTarget Model=VGG-19, Substitute Model=ShuffleNet-V2-2x2026.06 | 63.97 | 65.82 | 59.64 | 58.25 | 59.58 | 59.88 | |
| HGDTarget Model=VGG-19, Substitute Model=ResNet-V2-502026.06 | 61.93 | 62.83 | 61 | 58.83 | 60.92 | 61.32 | |
| HGDTarget Model=VGG-19, Substitute Model=ShuffleNet-V2-2x2026.06 | 57.73 | 62.83 | 58.88 | 56.36 | 57.37 | 58.09 | |
| Mixup InferenceEnvironment=White-box2026.06 | 29.46 | — | 0 | 0 | 0.01 | 0 | |
| Nat. Tra.Target Model=VGG-19, Substitute Model=ResNet-V2-502026.06 | 22.49 | 70.33 | 29.37 | 24.43 | 12.56 | 10.63 | |
| MAPEEnvironment=White-box2026.06 | 21.98 | — | 0.11 | 0.12 | 1.68 | 2.34 | |
| Nat. Tra.Target Model=VGG-19, Substitute Model=ShuffleNet-V2-2x2026.06 | 21.96 | 70.33 | 11.1 | 8.41 | 4.02 | 3.65 | |
| Adversarial TrainingEnvironment=White-box2026.06 | 21.37 | — | 15.42 | 16.26 | 16.14 | 16.33 | |
| LDTEnvironment=White-box2026.06 | 19.97 | — | 0.06 | 0.1 | 0.79 | 1.48 | |
| TVMEnvironment=White-box2026.06 | 18.84 | — | 4.49 | 5.16 | 6.77 | 7.38 | |
| Pixel DeflectionEnvironment=White-box2026.06 | 15.63 | — | 0.57 | 0.73 | 0.76 | 0.78 | |
| HGDEnvironment=White-box2026.06 | 13.93 | — | 0.05 | 0.06 | 0.46 | 0.52 | |
| Natural TrainingEnvironment=White-box2026.06 | 11.69 | — | 0.03 | 0.03 | 0.01 | 0.01 | |
| Feature DenoisingEnvironment=White-box2026.06 | 6.75 | — | 0.23 | 0.31 | 0.33 | 0.31 |