Image Classification on CIFAR10 (test) (Accuracy)
99.5AccuracyWiSE-FT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| WiSE-FTalpha=optimal2021.09 | 99.5 | — | — | |
| WiSE-FTalpha=0.52021.09 | 99.3 | — | — | |
| DeiT-BParams (M)=86.6, Fine-tuning=true2021.06 | 99.1 | — | — | |
| ViT-baseImplementation=Original2022.12 | 98.95 | — | — | |
| ViTAE-SParams (M)=23.6, Fine-tuning=true2021.06 | 98.8 | — | — | |
| ViT-baseImplementation=TencentPretrain2022.12 | 98.73 | — | — | |
| Standard fine-tuning2021.09 | 98.6 | — | — | |
| ARFCBackbone=SigLip 2 (ViT-B/16), Compression Ratio=50%, Evaluation Protocol=Zero-shot2026.02 | 98.5 | — | — | |
| BaselineBackbone=SigLip 2 (ViT-B/16), Compression Ratio=0%, Evaluation Protocol=Zero-shot2026.02 | 98.4 | — | — | |
| T2T-ViT-14Params (M)=21.5, Fine-tuning=true2021.06 | 98.3 | — | — | |
| EfficientNet-B5Params (M)=30, Fine-tuning=true2021.06 | 98.1 | — | — | |
| ViT-B/16Params (M)=86.5, Fine-tuning=true2021.06 | 98.1 | — | — | |
| Clust-PSI-PFLPartition protocol=Similarity, S=0, K=1002025.12 | 98 | — | — | |
| VaSSOBackbone=PyramidNet-1102023.09 | 97.93 | — | — | |
| ViT-L/16Params (M)=304.3, Fine-tuning=true2021.06 | 97.9 | — | — | |
| AutoEncoder-VAEBackbone=SigLip 2 (ViT-B/16), Compression Ratio=50%, Evaluation Protocol=Zero-shot2026.02 | 97.9 | — | — | |
| Invariance-Constrained LearningBackbone=Wide-ResNet-28-10, Augmentation Search Space=Wide2022.09 | 97.85 | — | — | |
| SAMBackbone=PyramidNet-1102023.09 | 97.85 | — | — | |
| FisherSAMBackbone=PyramidNet-1102023.09 | 97.84 | — | — | |
| BYOLEvaluation Protocol=Fine-tuned2021.06 | 97.8 | — | — | |
| SSL-HSIC (w/ target)Evaluation Protocol=Fine-tuned2021.06 | 97.8 | — | — | |
| Invariance-Constrained LearningBackbone=Wide-ResNet-28-10, Augmentation Search Space=Standard2022.09 | 97.74 | — | — | |
| SimCLREvaluation Protocol=Fine-tuned2021.06 | 97.7 | — | — | |
| ViTAE-TParams (M)=4.8, Epochs=1000, Training mode=from scratch2021.06 | 97.7 | — | — | |
| DeepAABackbone=Wide-ResNet-28-10, Augmentation Search Space=Standard2022.09 | 97.57 | — | — | |
| DeepAABackbone=WRN-28-10, Total Augmentations=6, Hard-coded Augmentations=02023.06 | 97.56 | — | — | |
| ASAMBackbone=PyramidNet-1102023.09 | 97.56 | — | — | |
| VaSSOBackbone=WRN-28-102023.09 | 97.54 | — | — | |
| TABackbone=Wide-ResNet-28-10, Augmentation Search Space=Wide2022.09 | 97.51 | — | — | |
| Supervised-INEvaluation Protocol=Fine-tuned2021.06 | 97.5 | — | — | |
| DeiT-BParams (M)=86.0, Epochs=7000, Training mode=from scratch2021.06 | 97.5 | — | — | |
| TeachABackbone=WRN-28-10, Total Augmentations=4, Hard-coded Augmentations=22023.06 | 97.5 | — | — | |
| Q-FormerBackbone=SigLip 2 (ViT-B/16), Compression Ratio=50%, Evaluation Protocol=Zero-shot2026.02 | 97.5 | — | — | |
| TA (Wide)Backbone=WRN-28-10, Total Augmentations=3, Hard-coded Augmentations=22023.06 | 97.46 | — | — | |
| SLACKBackbone=WRN-28-10, Total Augmentations=3, Hard-coded Augmentations=02023.06 | 97.46 | — | — | |
| TABackbone=Wide-ResNet-28-10, Augmentation Search Space=Standard2022.09 | 97.46 | — | — | |
| FisherSAMBackbone=WRN-28-102023.09 | 97.46 | — | — | |
| SparseSwin#Params(10 class)=17.58 M, Input Resolution=224x224, Model Type=Transformer2023.09 | 97.43 | — | — | |
| SSL-HSIC (w/o target)Evaluation Protocol=Fine-tuned2021.06 | 97.4 | — | — | |
| AABackbone=WRN-28-10, Total Augmentations=4, Hard-coded Augmentations=22023.06 | 97.4 | — | — | |
| SpikingResformerType=Transfer Learning, T=42024.03 | 97.4 | — | — | |
| SGDBackbone=PyramidNet-1102023.09 | 97.39 | — | — | |
| UniformAugmentBackbone=WRN-28-10, Total Augmentations=4, Hard-coded Augmentations=22023.06 | 97.33 | — | — | |
| SAMBackbone=WRN-28-102023.09 | 97.32 | — | — | |
| ViTAE-TParams (M)=4.8, Fine-tuning=true2021.06 | 97.3 | — | — | |
| FastAABackbone=WRN-28-10, Total Augmentations=4, Hard-coded Augmentations=22023.06 | 97.3 | — | — | |
| DADABackbone=WRN-28-10, Total Augmentations=4, Hard-coded Augmentations=22023.06 | 97.3 | — | — | |
| RABackbone=WRN-28-10, Total Augmentations=4, Hard-coded Augmentations=22023.06 | 97.3 | — | — | |
| DenseNet-BC-190+Mixup#Params(10 class)=25.6 M, Input Resolution=224x224, Model Type=Convolution2023.09 | 97.3 | — | — | |
| DeepAA (reproduced)Backbone=WRN-28-10, Total Augmentations=6, Hard-coded Augmentations=02023.06 | 97.27 | — | — | |
| DeepAABackbone=Wide-ResNet-28-10, Augmentation Search Space=Wide2022.09 | 97.27 | — | — | |
| Uniform policyBackbone=WRN-28-10, Total Augmentations=3, Hard-coded Augmentations=02023.06 | 97.26 | — | — | |
| Softmax + SAM2022.09 | 97.2 | — | — | |
| CRATEModel variant=L, # parameters=77.64M, Pre-training=ImageNet, Evaluation Protocol=Fine-tuning2023.06 | 97.2 | — | — | |
| ViTModel variant=S, # parameters=22.05M, Pre-training=ImageNet, Evaluation Protocol=Fine-tuning2023.06 | 97.2 | — | — | |
| NesT-B#Params(10 class)=97.2 M, Input Resolution=32x32, Model Type=Transformer2023.09 | 97.2 | — | — | |
| CRATE-L#Params(10 class)=77.64 M, Input Resolution=224x224, Model Type=Transformer2023.09 | 97.2 | — | — | |
| ASAMBackbone=WRN-28-102023.09 | 97.15 | — | — | |
| SAMNetwork=ResNet34, Optimizer=SAM, Cutout=true, Batch size=128, Epochs=2502022.03 | 97.1 | — | — | |
| SGDBackbone=WRN-28-102023.09 | 97.08 | — | — | |
| Invariance-Constrained LearningBackbone=Wide-ResNet-40-2, Augmentation Search Space=Wide2022.09 | 97.05 | — | — | |
| SpikformerType=Transfer Learning, T=42024.03 | 97.03 | — | — | |
| PTQ-P4Q (8bit)-FTBackbone=SigLip 2 (ViT-B/16), Compression Ratio=75%, Evaluation Protocol=Zero-shot2026.02 | 96.9 | — | — | |
| ResNet XnIDR#Params(10 class)=23.86 M, Input Resolution=224x224, Model Type=Convolution2023.09 | 96.87 | — | — | |
| CRATEModel variant=B, # parameters=22.80M, Pre-training=ImageNet, Evaluation Protocol=Fine-tuning2023.06 | 96.8 | — | — | |
| CRATE-B#Params(10 class)=22.80 M, Input Resolution=224x224, Model Type=Transformer2023.09 | 96.8 | — | — | |
| SAMNetwork=ResNet101, Optimizer=SAM, Cutout=true, Batch size=128, Epochs=2502022.03 | 96.79 | — | — | |
| VaSSOBackbone=ResNet-182023.09 | 96.77 | — | — | |
| Invariance-Constrained LearningBackbone=Wide-ResNet-40-2, Augmentation Search Space=Standard2022.09 | 96.76 | — | — | |
| FisherSAMBackbone=ResNet-182023.09 | 96.72 | — | — | |
| SGDPNetwork=ResNet34, Augmentation=Cutout2022.03 | 96.7 | — | — | |
| SGDPNetwork=ResNet34, Optimizer=SGDP, Cutout=true, Batch size=128, Epochs=2502022.03 | 96.7 | — | — | |
| SAMNetwork=ResNet34, Augmentation=Cutout2022.03 | 96.64 | — | — | |
| ViTModel variant=T, # parameters=5.72M, Pre-training=ImageNet, Evaluation Protocol=Fine-tuning2023.06 | 96.6 | — | — | |
| SAMBackbone=ResNet-182023.09 | 96.58 | — | — | |
| TABackbone=Wide-ResNet-40-2, Augmentation Search Space=Standard2022.09 | 96.55 | — | — | |
| SGDNetwork=ResNet34, Augmentation=Cutout2022.03 | 96.53 | — | — | |
| SGDNetwork=ResNet34, Optimizer=SGD, Cutout=true, Batch size=128, Epochs=2502022.03 | 96.53 | — | — | |
| SAMNetwork=ResNet50, Optimizer=SAM, Cutout=true, Batch size=128, Epochs=2502022.03 | 96.49 | — | — | |
| SAMNetwork=ResNet18, Optimizer=SAM, Cutout=true, Batch size=128, Epochs=2502022.03 | 96.44 | — | — | |
| SAMNetwork=SENet18, Optimizer=SAM, Cutout=true, Batch size=128, Epochs=2502022.03 | 96.44 | — | — | |
| DeepAABackbone=Wide-ResNet-40-2, Augmentation Search Space=Standard2022.09 | 96.43 | — | — | |
| RMSGDNetwork=ResNet34, Augmentation=Cutout2022.03 | 96.42 | — | — | |
| RMSGDNetwork=ResNet34, Optimizer=RMSGD, Cutout=true, Batch size=128, Epochs=2502022.03 | 96.42 | — | — | |
| FastAABackbone=WRN-40-2, Total Augmentations=4, Hard-coded Augmentations=22023.06 | 96.4 | — | — | |
| DADABackbone=WRN-40-2, Total Augmentations=4, Hard-coded Augmentations=22023.06 | 96.4 | — | — | |
| PTQ-MinMax (8bit)-FTBackbone=SigLip 2 (ViT-B/16), Compression Ratio=75%, Evaluation Protocol=Zero-shot2026.02 | 96.4 | — | — | |
| RMSGDNetwork=ResNet101, Augmentation=Cutout2022.03 | 96.33 | — | — | |
| RMSGDNetwork=ResNet101, Optimizer=RMSGD, Cutout=true, Batch size=128, Epochs=2502022.03 | 96.33 | — | — | |
| ASAMBackbone=ResNet-182023.09 | 96.33 | — | — | |
| TA (Wide)Backbone=WRN-40-2, Total Augmentations=3, Hard-coded Augmentations=22023.06 | 96.32 | — | — | |
| AABackbone=WRN-40-2, Total Augmentations=4, Hard-coded Augmentations=22023.06 | 96.3 | — | — | |
| SLACKBackbone=WRN-40-2, Total Augmentations=3, Hard-coded Augmentations=02023.06 | 96.29 | — | — | |
| RMSGDNetwork=ResNet50, Augmentation=Cutout2022.03 | 96.28 | — | — | |
| RMSGDNetwork=ResNet50, Optimizer=RMSGD, Cutout=true, Batch size=128, Epochs=2502022.03 | 96.28 | — | — | |
| DeepAABackbone=Wide-ResNet-40-2, Augmentation Search Space=Wide2022.09 | 96.27 | — | — | |
| UniformAugmentBackbone=WRN-40-2, Total Augmentations=4, Hard-coded Augmentations=22023.06 | 96.25 | — | — | |
| DeepAA (reproduced)Backbone=WRN-40-2, Total Augmentations=6, Hard-coded Augmentations=02023.06 | 96.25 | — | — | |
| SGDBackbone=ResNet-182023.09 | 96.25 | — | — | |
| TABackbone=Wide-ResNet-40-2, Augmentation Search Space=Wide2022.09 | 96.24 | — | — |