Image Classification on Tiny ImageNet (Standard and Robust Accuracy via AutoAttack)
71.97Standard AccuracyViT
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| ViTSetup=Standard Baseline (fst), Compression=None2024.03 | 71.97 | 0.02 | — | — | — | — | — | |
| WideResNet-50Setup=Standard Baseline (fst), Compression=None2024.03 | 69.5 | 0.15 | — | — | — | — | — | |
| ViTSetup=Adversarial Fine-tuning (Tad), Compression=INT8 Quantization2024.03 | 68.84 | 0.36 | — | — | — | — | — | |
| ViTSetup=Robust Baseline (frb), Compression=None2024.03 | 67.66 | 0.35 | — | — | — | — | — | |
| WideResNet-50Setup=Standard Fine-tuning (Tst), Compression=INT8 Quantization2024.03 | 67.51 | 0.14 | — | — | — | — | — | |
| ViTSetup=Standard Fine-tuning (Tst), Compression=INT8 Quantization2024.03 | 67.31 | 0.13 | — | — | — | — | — | |
| WideResNet-50Setup=Standard Fine-tuning (Tst), Compression=l1-Pruning (80% sparsity)2024.03 | 65.35 | 5.69 | — | — | — | — | — | |
| ViTSetup=Standard Fine-tuning (Tst), Compression=l1-Pruning (80% sparsity)2024.03 | 64.86 | 6.95 | — | — | — | — | — | |
| WideResNet-50Setup=Robust Baseline (frb), Compression=None2024.03 | 63.94 | 0.36 | — | — | — | — | — | |
| ViTSetup=Adversarial Fine-tuning (Tad), Compression=l1-Pruning (80% sparsity)2024.03 | 63.61 | 10.14 | — | — | — | — | — | |
| WideResNet-50Setup=Adversarial Fine-tuning (Tad), Compression=l1-Pruning (80% sparsity)2024.03 | 62.98 | 9.75 | — | — | — | — | — | |
| WideResNet-50Setup=Adversarial Fine-tuning (Tad), Compression=INT8 Quantization2024.03 | 62.66 | 0.41 | — | — | — | — | — | |
| RiFTBackbone=WideResNet-34-10, Training Strategy=TRADES2026.06 | 55.79 | 18.03 | 27.53 | 24.27 | 23.36 | 20.2 | 19.68 | |
| RiFTBackbone=WideResNet-34-10, Training Strategy=AT2026.06 | 55.03 | 19.06 | 27.2 | 23.29 | 22.34 | 22.13 | 20.42 | |
| FPCMBackbone=WideResNet-34-10, Training Strategy=AT2026.06 | 54.92 | 19.8 | 27.7 | 24.3 | 23.42 | 22.45 | 20.98 | |
| TRADESBackbone=WideResNet-34-10, Training Strategy=TRADES2026.06 | 53.96 | 18.2 | 27.08 | 24.09 | 23.88 | 19.76 | 19.38 | |
| RiFTBackbone=WideResNet-34-10, Training Strategy=MART2026.06 | 53.61 | 19.76 | 28.37 | 24.9 | 24.3 | 22.2 | 21.18 | |
| A3Backbone=WideResNet-34-10, Training Strategy=MART2026.06 | 53.48 | 20.69 | 29.49 | — | 25.28 | 23.85 | 22.25 | |
| EMFFBackbone=WideResNet-34-10, Training Strategy=TRADES2026.06 | 53.45 | 19.99 | 27.49 | 25.22 | 24.91 | 21.11 | 20.87 | |
| FPCMBackbone=WideResNet-34-10, Training Strategy=TRADES2026.06 | 53.13 | 19.75 | 27.17 | 25.08 | 24.83 | 21.25 | 20.86 | |
| FPCMBackbone=WideResNet-34-10, Training Strategy=MART2026.06 | 53.12 | 20.37 | 28.57 | 26.06 | 25.49 | 22.76 | 21.9 | |
| A3Backbone=WideResNet-34-10, Training Strategy=TRADES2026.06 | 52.88 | 19.07 | 27.92 | 25.28 | 24.89 | 20.96 | 20.6 | |
| ATBackbone=WideResNet-34-10, Training Strategy=AT2026.06 | 52.78 | 18.79 | 26.25 | 22.84 | 22.13 | 21.62 | 19.93 | |
| CASBackbone=WideResNet-34-10, Training Strategy=TRADES2026.06 | 52.42 | 17.41 | 27.64 | 24.5 | 24 | 20.03 | 19.43 | |
| CIFSBackbone=WideResNet-34-10, Training Strategy=TRADES2026.06 | 52.19 | 17.28 | 27.79 | 24.47 | 24.12 | 19.84 | 19.59 | |
| MARTBackbone=WideResNet-34-10, Training Strategy=MART2026.06 | 52.06 | 19.31 | 27.93 | 24.86 | 24.43 | 21.73 | 20.82 | |
| A3Backbone=WideResNet-34-10, Training Strategy=AT2026.06 | 51.92 | 20.43 | 27.86 | 25.27 | 24.48 | 23.32 | 21.87 | |
| RiFTBackbone=ResNet-18, Training Strategy=TRADES2026.06 | 51.91 | 13.94 | 23.92 | 21.13 | 20.28 | 16.82 | 16.37 | |
| CASBackbone=WideResNet-34-10, Training Strategy=MART2026.06 | 51.88 | 18.63 | 28.15 | 24.87 | 24.26 | 22.06 | 20.93 | |
| EMFFBackbone=WideResNet-34-10, Training Strategy=MART2026.06 | 51.88 | 21.35 | 28.25 | 25.65 | 25.09 | 23.24 | 22.23 | |
| CIFSBackbone=WideResNet-34-10, Training Strategy=AT2026.06 | 51.72 | 17.09 | 26.65 | 23.21 | 22.59 | 21.57 | 20.01 | |
| RiFTBackbone=ResNet-18, Training Strategy=AT2026.06 | 51.67 | 16.64 | 24.44 | 21.14 | 20.48 | 19.28 | 18.04 | |
| CIFSBackbone=WideResNet-34-10, Training Strategy=MART2026.06 | 51.49 | 18.8 | 28.24 | 24.99 | 24.51 | 21.79 | 20.72 | |
| CASBackbone=WideResNet-34-10, Training Strategy=AT2026.06 | 51.47 | 17.36 | 26.58 | 22.97 | 22.14 | 21.87 | 19.82 | |
| A3Backbone=ResNet-18, Training Strategy=AT2026.06 | 51.1 | 18.25 | 25.46 | 22.97 | 22.02 | 21.32 | 19.78 | |
| A3Backbone=ResNet-18, Training Strategy=MART2026.06 | 51.03 | 18.96 | 26.36 | 23.89 | 23.34 | 21.78 | 20.67 | |
| EMFFBackbone=ResNet-18, Training Strategy=TRADES2026.06 | 50.6 | 16.38 | 24.09 | 22.1 | 21.74 | 17.37 | 17.21 | |
| FSRBackbone=WideResNet-34-10, Training Strategy=TRADES2026.06 | 50.59 | 18.39 | 27.31 | 24.84 | 24.23 | 20.29 | 19.82 | |
| FTA2CBackbone=WideResNet-34-10, Training Strategy=TRADES2026.06 | 50.5 | 18.8 | 27.65 | 24.63 | 23.93 | 20.51 | 19.87 | |
| FSRBackbone=WideResNet-34-10, Training Strategy=MART2026.06 | 50.5 | 19.51 | 28.03 | 24.89 | 24.51 | 21.77 | 20.91 | |
| FTA2CBackbone=WideResNet-34-10, Training Strategy=MART2026.06 | 50.44 | 20.11 | 28.25 | 25.16 | 24.89 | 22.3 | 21.57 | |
| ATBackbone=ResNet-18, Training Strategy=AT2026.06 | 50.33 | 16.42 | 23.83 | 20.34 | 19.91 | 18.96 | 17.49 | |
| RiFTBackbone=ResNet-18, Training Strategy=MART2026.06 | 50.2 | 17.4 | 25.39 | 22.76 | 22.29 | 19.74 | 18.81 | |
| EMFFBackbone=WideResNet-34-10, Training Strategy=AT2026.06 | 50.12 | 19.45 | 26.36 | 23.88 | 23.31 | 21.85 | 20.65 | |
| TRADESBackbone=ResNet-18, Training Strategy=TRADES2026.06 | 49.95 | 14.8 | 23.38 | 20.74 | 20.46 | 16.83 | 16.14 | |
| FPCMBackbone=ResNet-18, Training Strategy=TRADES2026.06 | 49.93 | 16.08 | 24.29 | 22.35 | 22 | 18.29 | 17.64 | |
| FTA2CBackbone=WideResNet-34-10, Training Strategy=AT2026.06 | 49.88 | 18.93 | 26.28 | 23.14 | 22.49 | 21.84 | 19.97 | |
| FSRBackbone=WideResNet-34-10, Training Strategy=AT2026.06 | 49.64 | 19.28 | 26.56 | 23.4 | 22.62 | 21.71 | 20.1 | |
| CASBackbone=ResNet-18, Training Strategy=AT2026.06 | 48.85 | 15.19 | 24.16 | 20.56 | 20.11 | 19.08 | 17.3 | |
| CASBackbone=ResNet-18, Training Strategy=TRADES2026.06 | 48.64 | 13.82 | 23.27 | 20.93 | 20.77 | 16.91 | 16.09 | |
| CIFSBackbone=ResNet-18, Training Strategy=AT2026.06 | 48.63 | 15.73 | 24.52 | 20.89 | 20.38 | 18.46 | 17.49 | |
| FTA2CBackbone=ResNet-18, Training Strategy=AT2026.06 | 48.62 | 15.3 | 22.59 | 20.69 | 20.5 | 16.62 | 16.28 | |
| FTA2CBackbone=ResNet-18, Training Strategy=TRADES2026.06 | 48.62 | 15.32 | 22.64 | 20.63 | 20.46 | 16.92 | 16.29 | |
| EMFFBackbone=ResNet-18, Training Strategy=AT2026.06 | 48.49 | 17.43 | 24.16 | 21.69 | 21.06 | 19.45 | 18.54 | |
| FPCMBackbone=ResNet-18, Training Strategy=MART2026.06 | 48.45 | 15.88 | 22.31 | 19.47 | 18.96 | 17.62 | 16.84 | |
| A3Backbone=ResNet-18, Training Strategy=TRADES2026.06 | 48.44 | 17.73 | 24.95 | 23.27 | 22.86 | 19.33 | 18.9 | |
| FSRBackbone=ResNet-18, Training Strategy=AT2026.06 | 48.16 | 16.6 | 24.35 | 20.71 | 20.28 | 19.37 | 17.52 | |
| MARTBackbone=ResNet-18, Training Strategy=MART2026.06 | 48.05 | 16.92 | 24.48 | 22.21 | 21.79 | 19.34 | 18.23 | |
| CIFSBackbone=ResNet-18, Training Strategy=TRADES2026.06 | 47.98 | 13.97 | 23.55 | 21.11 | 20.92 | 16.76 | 16.22 | |
| CASBackbone=ResNet-18, Training Strategy=MART2026.06 | 46.64 | 15.73 | 23.75 | 21.79 | 20.3 | 18.86 | 17.69 | |
| CIFSBackbone=ResNet-18, Training Strategy=MART2026.06 | 46.46 | 15.44 | 23.63 | 21.84 | 20.38 | 18.65 | 17.56 | |
| EMFFBackbone=ResNet-18, Training Strategy=MART2026.06 | 46.44 | 18.17 | 24.62 | 22.93 | 22.59 | 19.83 | 19.28 | |
| FSRBackbone=ResNet-18, Training Strategy=MART2026.06 | 45.85 | 16.23 | 23.11 | 20.86 | 20.57 | 17.98 | 17.33 | |
| FSRBackbone=ResNet-18, Training Strategy=TRADES2026.06 | 45.77 | 14.47 | 21.41 | 19.59 | 19.37 | 15.69 | 15.4 | |
| FPCMBackbone=ResNet-18, Training Strategy=AT2026.06 | 45.71 | 17.21 | 24.8 | 22.54 | 22.3 | 19.68 | 18.53 | |
| FTA2CBackbone=ResNet-18, Training Strategy=MART2026.06 | 42.56 | 15.53 | 22.3 | 20.56 | 20.63 | 20.43 | 17.15 |