Image Classification on ImageNet 1.0 (val)
80.1AccuracyClean
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| CleanModel=ResNet-502026.04 | 80.1 | 100 | |
| CleanModel=ViT-B/162026.04 | 80 | 100 | |
| CleanModel=ViT-L/162026.04 | 78.83 | 100 | |
| JPEGModel=ViT-B/162026.04 | 70.66 | 29.27 | |
| JPEGModel=ViT-L/162026.04 | 68.67 | 29.27 | |
| PCAModel=ViT-L/162026.04 | 67.32 | 27.53 | |
| PCAModel=ViT-B/162026.04 | 67.29 | 27.68 | |
| CleanModel=ResNet-182026.04 | 67.28 | 100 | |
| JPEGModel=ResNet-502026.04 | 66.29 | 29.22 | |
| BestClfEnsemble size=5, Classes (K)=10002026.01 | 60.83 | — | |
| LA2passEnsemble size=5, Classes (K)=10002026.01 | 57.98 | — | |
| DEEMEnsemble size=5, Classes (K)=10002026.01 | 57.47 | — | |
| iRBMEnsemble size=5, Classes (K)=10002026.01 | 57.37 | — | |
| MVEnsemble size=5, Classes (K)=10002026.01 | 56.41 | — | |
| DSEnsemble size=5, Classes (K)=10002026.01 | 56.24 | — | |
| HLMEnsemble size=5, Classes (K)=10002026.01 | 56.21 | — | |
| JPEGModel=ResNet-182026.04 | 54.67 | 29.41 | |
| PCAModel=ResNet-502026.04 | 54.05 | 27.47 | |
| FGSMModel=ResNet-502026.04 | 52.46 | 14.26 | |
| FGSMModel=ViT-L/162026.04 | 48.21 | 14.44 | |
| FGSMModel=ViT-B/162026.04 | 46.78 | 14.37 | |
| PCAModel=ResNet-182026.04 | 41.77 | 27.53 | |
| JPEG → FGSMModel=ViT-L/162026.04 | 33.63 | 31.53 | |
| JPEG → FGSMModel=ViT-B/162026.04 | 33.49 | 31.56 | |
| PCA → FGSMModel=ResNet-502026.04 | 33.46 | 30.71 | |
| JPEG → FGSMModel=ResNet-502026.04 | 32.64 | 31.41 | |
| PCA → FGSMModel=ViT-B/162026.04 | 25.22 | 30.86 | |
| PCA → FGSMModel=ViT-L/162026.04 | 23.4 | 30.86 | |
| L-SMLEnsemble size=5, Classes (K)=10002026.01 | 20.33 | — | |
| FGSMModel=ResNet-182026.04 | 15.45 | 14.53 | |
| PGDModel=ResNet-502026.04 | 9.67 | 38.25 | |
| AutoAttackModel=ViT-L/162026.04 | 6.87 | 45.58 | |
| AutoAttackModel=ResNet-182026.04 | 6.64 | 47.84 | |
| PGDModel=ViT-L/162026.04 | 6.3 | 37.87 | |
| AutoAttackModel=ViT-B/162026.04 | 5.85 | 47.8 | |
| PGDModel=ViT-B/162026.04 | 5.12 | 37.93 | |
| AutoAttackModel=ResNet-502026.04 | 3.82 | 49.02 | |
| JPEG → FGSMModel=ResNet-182026.04 | 1.47 | 31.41 | |
| PCA → PGDModel=ResNet-502026.04 | 1 | 32.61 | |
| JPEG → PGDModel=ResNet-502026.04 | 0.98 | 30.57 | |
| PCA → FGSMModel=ResNet-182026.04 | 0.64 | 30.86 | |
| PCA → PGDModel=ViT-L/162026.04 | 0.6 | 32.42 | |
| JPEG → PGDModel=ViT-L/162026.04 | 0.59 | 30.46 | |
| JPEG → PGDModel=ViT-B/162026.04 | 0.57 | 30.46 | |
| PCA → PGDModel=ViT-B/162026.04 | 0.48 | 32.44 | |
| PGDModel=ResNet-182026.04 | 0.01 | 38.04 | |
| JPEG → PGDModel=ResNet-182026.04 | 0 | 30.48 | |
| PCA → PGDModel=ResNet-182026.04 | 0 | 32.48 |