Image Classification on CIFAR-10 (test) (Accuracy)
99.1AccuracyDeiT-B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| DeiT-BParams=86M, Pre-trained=ImageNet ILSVRC2012, Evaluation Protocol=finetuned2021.04 | 99.1 | — | — | — | — | |
| DeiT-B-384Params=86M, Pre-trained=ImageNet ILSVRC2012, Evaluation Protocol=finetuned2021.04 | 99.1 | — | — | — | — | |
| EfficientNetV2-LParams=121M, Pre-trained=ImageNet ILSVRC2012, Evaluation Protocol=finetuned2021.04 | 99.1 | — | — | — | — | |
| DeiT-BParams (M)=86.4, Resolution=384x384, Pre-training=ImageNet2021.02 | 99.1 | — | — | — | — | |
| TNT-BParams (M)=65.6, Resolution=384x384, Pre-training=ImageNet2021.02 | 99.1 | — | — | — | — | |
| GPipe (AmoebaNet-B (18, 512))Architecture=AmoebaNet-B (18, 512), Resolution=480x480, Protocol=Fine-tuned, Number of fine-tuning runs=5, Crop=Single-crop2018.11 | 99 | — | — | — | — | |
| GPipeParams=556M, Pre-trained=ImageNet ILSVRC2012, Evaluation Protocol=finetuned2021.04 | 99 | — | — | — | — | |
| EfficientNetV2-MParams=55M, Pre-trained=ImageNet ILSVRC2012, Evaluation Protocol=finetuned2021.04 | 99 | — | — | — | — | |
| EfficientNet-B7Params=66M, Pre-trained=ImageNet ILSVRC2012, Evaluation Protocol=finetuned2021.04 | 98.9 | — | — | — | — | |
| WideNet-LParameters=38M, Mode=Finetuning2021.07 | 98.8 | — | — | — | — | |
| EfficientNetV2-SParams=24M, Pre-trained=ImageNet ILSVRC2012, Evaluation Protocol=finetuned2021.04 | 98.7 | — | — | — | — | |
| R50+ViT-B_16Backbone=R50+ViT-B_16, Pre-trained=ImageNet-21k, Evaluation Protocol=Fine-tuned2021.06 | 98.7 | — | — | — | — | |
| EfficientNet-B5Params (M)=30, Resolution=384x384, Pre-training=ImageNet2021.02 | 98.7 | — | — | — | — | |
| TNT-SParams (M)=23.8, Resolution=384x384, Pre-training=ImageNet2021.02 | 98.7 | — | — | — | — | |
| ViT-B/16-SAMBackbone=ViT-B/16, SAM Pre-training=true, SAM Fine-tuning=false, Resolution=224x224, Pre-trained on=ImageNet2021.06 | 98.6 | — | — | — | — | |
| Cubuk et al.Protocol=Trained from scratch2018.11 | 98.5 | — | — | — | — | |
| ViT-MoE-BParameters=126M, Mode=Finetuning2021.07 | 98.5 | — | — | — | — | |
| ViT-MoE-LParameters=404M, Mode=Finetuning2021.07 | 98.5 | — | — | — | — | |
| WideNet-BParameters=27M, Mode=Finetuning2021.07 | 98.4 | — | — | — | — | |
| ViT-BParameters=85M, Mode=Finetuning2021.07 | 98.3 | — | — | — | — | |
| FairNAS-AInput Size=224x224, x+ (M)=391, SE and Swish=true2019.07 | 98.2 | — | — | — | — | |
| ViT-LParameters=305M, Mode=Finetuning2021.07 | 98.2 | — | — | — | — | |
| ResNet-152-SAMBackbone=ResNet-152, SAM Pre-training=true, SAM Fine-tuning=false, Resolution=224x224, Pre-trained on=ImageNet2021.06 | 98.2 | — | — | — | — | |
| ViT-S/16-SAMBackbone=ViT-S/16, SAM Pre-training=true, SAM Fine-tuning=false, Resolution=224x224, Pre-trained on=ImageNet2021.06 | 98.2 | — | — | — | — | |
| ViT-B/16Params=87M, Pre-trained=ImageNet ILSVRC2012, Evaluation Protocol=finetuned2021.04 | 98.1 | — | — | — | — | |
| EfficientNet-B0Input Size=224x224, x+ (M)=3872019.07 | 98.1 | — | — | — | — | |
| FairNAS-BInput Size=224x224, x+ (M)=348, SE and Swish=true2019.07 | 98.1 | — | — | — | — | |
| ViT-B_16Backbone=ViT-B_16, Pre-trained=ImageNet-21k, Evaluation Protocol=Fine-tuned2021.06 | 98.1 | — | — | — | — | |
| ViT-B/16Params (M)=86.4, Resolution=384x384, Pre-training=ImageNet2021.02 | 98.1 | — | — | — | — | |
| ViT-B/16Backbone=ViT-B/16, SAM Pre-training=false, Resolution=224x224, Pre-trained on=ImageNet2021.06 | 98.1 | — | — | — | — | |
| NASNet-A LargeInput Size=331x331, x+ (M)=120302019.07 | 98 | — | — | — | — | |
| FairNAS-CInput Size=224x224, x+ (M)=324, SE and Swish=true2019.07 | 98 | — | — | — | — | |
| ViT-L/32Params=306M, Pre-trained=ImageNet ILSVRC2012, Evaluation Protocol=finetuned2021.04 | 97.9 | — | — | — | — | |
| ViT-L/16Params=306M, Pre-trained=ImageNet ILSVRC2012, Evaluation Protocol=finetuned2021.04 | 97.9 | — | — | — | — | |
| MixNet-MInput Size=224x224, x+ (M)=3592019.07 | 97.9 | — | — | — | — | |
| ViT-B/32Params=88M, Pre-trained=ImageNet ILSVRC2012, Evaluation Protocol=finetuned2021.04 | 97.8 | — | — | — | — | |
| Mixer-B/16-SAMBackbone=Mixer-B/16, SAM Pre-training=true, SAM Fine-tuning=false, Resolution=224x224, Pre-trained on=ImageNet2021.06 | 97.8 | — | — | — | — | |
| MIM-DARTSSearch Cost (GPU-Days)=0.2, Params(M)=4.1, Search Dataset=CIFAR-10, Selection=Best results2022.11 | 97.71 | — | — | — | — | |
| ViT-S/16Backbone=ViT-S/16, SAM Pre-training=false, Resolution=224x224, Pre-trained on=ImageNet2021.06 | 97.6 | — | — | — | — | |
| CyDASSearch Cost (GPU-Days)=0.3, Params(M)=3.6, Selection=Best searched architecture2022.11 | 97.6 | — | — | — | — | |
| MIM-DARTSSearch Cost (GPU-Days)=0.2, Params(M)=3.73, Search Dataset=CIFAR-100, Selection=Best results2022.11 | 97.59 | — | — | — | — | |
| MLP-Mixer-B_16Backbone=MLP-Mixer-B_16, Pre-trained=ImageNet-21k, Evaluation Protocol=Fine-tuned2021.06 | 97.58 | — | — | — | — | |
| NoisyDARTSSearch Space=S3, Search Space Strategy=OFS, Aggregation Protocol=Best of 3 runs2020.05 | 97.53 | — | — | — | — | |
| SDARTS-ADVSearch Space=S3, Search Space Strategy=OFS, Aggregation Protocol=Best of 3 runs2020.05 | 97.51 | — | — | — | — | |
| P-DARTSSearch Cost (GPU-Days)=0.3, Params(M)=3.4, Search Dataset=CIFAR-10, Selection=Best searched architecture2022.11 | 97.5 | — | — | — | — | |
| RDARTS-L2Search Space=S3, Search Space Strategy=OFS, Aggregation Protocol=Best of 3 runs2020.05 | 97.49 | — | — | — | — | |
| BiT-M R50x1Backbone=BiT-M R50x1, Pre-trained=ImageNet-21k, Evaluation Protocol=Fine-tuned2021.06 | 97.47 | — | — | — | — | |
| SDARTS-RSSearch Space=S3, Search Space Strategy=OFS, Aggregation Protocol=Best of 3 runs2020.05 | 97.47 | — | — | — | — | |
| NoisyDARTSSearch Space=S3, Search Space Strategy=OFS, Aggregation Protocol=Average of 3 runs2020.05 | 97.42 | — | — | — | — | |
| ResNet-50-SAMBackbone=ResNet-50, SAM Pre-training=true, SAM Fine-tuning=false, Resolution=224x224, Pre-trained on=ImageNet2021.06 | 97.4 | — | — | — | — | |
| P-DARTSSearch Cost (GPU-Days)=0.3, Search Dataset=CIFAR-100, Selection=Best searched architecture2022.11 | 97.38 | — | — | — | — | |
| Non-Privateprivacy_setting=Non-Private2026.01 | 97.37 | — | — | — | — | |
| BiT-M R101x3Backbone=BiT-M R101x3, Pre-trained=ImageNet-21k, Evaluation Protocol=Fine-tuned2021.06 | 97.36 | — | — | — | — | |
| NASNet-ASearch Cost (GPU-Days)=2000, Params(M)=3.3, Selection=Best searched architecture2022.11 | 97.35 | — | — | — | — | |
| NoisyDARTSSearch Space=S4, Search Space Strategy=NFA, Aggregation Protocol=Best of 3 runs2020.05 | 97.29 | — | — | — | — | |
| SDARTS-ADVSearch Space=S1, Search Space Strategy=OFS, Aggregation Protocol=Best of 3 runs2020.05 | 97.27 | — | — | — | — | |
| NoisyDARTSSearch Space=S1, Search Space Strategy=OFS, Aggregation Protocol=Best of 3 runs2020.05 | 97.27 | — | — | — | — | |
| RDARTS-L2Search Space=S1, Search Space Strategy=OFS, Aggregation Protocol=Best of 3 runs2020.05 | 97.22 | — | — | — | — | |
| SDARTS-RSSearch Space=S1, Search Space Strategy=OFS, Aggregation Protocol=Best of 3 runs2020.05 | 97.22 | — | — | — | — | |
| NoisyDARTSSearch Space=S4, Search Space Strategy=NFA, Aggregation Protocol=Average of 3 runs2020.05 | 97.22 | — | — | — | — | |
| MaxUp + CutoutBackbone=WideResNet-28-102020.02 | 97.18 | — | — | — | — | |
| SWABackbone=ShakeShake-2x64d, Base Budget=1800, Training Budget=1.25 Budgets2018.03 | 97.16 | — | — | — | — | |
| SDARTS-ADVSearch Space=S4, Search Space Strategy=NFA, Aggregation Protocol=Best of 3 runs2020.05 | 97.13 | — | — | — | — | |
| SWABackbone=ShakeShake-2x64d, Base Budget=1800, Training Budget=1.5 Budgets2018.03 | 97.12 | — | — | — | — | |
| SDARTS-RSSearch Space=S4, Search Space Strategy=NFA, Aggregation Protocol=Best of 3 runs2020.05 | 97.07 | — | — | — | — | |
| GDASSearch Cost (GPU-Days)=0.2, Params(M)=3.4, Selection=Best searched architecture2022.11 | 97.07 | — | — | — | — | |
| NoisyDARTSSearch Space=S1, Search Space Strategy=OFS, Aggregation Protocol=Average of 3 runs2020.05 | 97.05 | — | — | — | — | |
| RDARTS-ADASearch Space=S3, Search Space Strategy=OFS, Aggregation Protocol=Average of 3 runs2020.05 | 97.01 | — | — | — | — | |
| RDARTS-ADASearch Space=S1, Search Space Strategy=OFS, Aggregation Protocol=Average of 3 runs2020.05 | 96.97 | — | — | — | — | |
| OT-MDRBackbone=WideResnet28x10, Number of particles=12023.06 | 96.97 | — | — | — | — | |
| RDARTS-ESSearch Space=S1, Search Space Strategy=OFS, Aggregation Protocol=Average of 3 runs2020.05 | 96.95 | — | — | — | — | |
| SGDBackbone=ShakeShake-2x64d, Base Budget=18002018.03 | 96.93 | — | — | — | — | |
| CutoutBackbone=WideResNet-28-102020.02 | 96.92 | — | — | — | — | |
| SWABackbone=WRN-28-10, Base Budget=200, Training Budget=1.5 Budgets2018.03 | 96.79 | — | — | — | — | |
| SAMBackbone=WideResnet28x10, Number of particles=12023.06 | 96.72 | — | — | — | — | |
| NoisyDARTSSearch Space=S2, Search Space Strategy=OFS, Aggregation Protocol=Best of 3 runs2020.05 | 96.71 | — | — | — | — | |
| SAM-IREBackbone=WRN-28-102024.05 | 96.7 | — | — | — | — | |
| RDARTS-L2Search Space=S2, Search Space Strategy=OFS, Aggregation Protocol=Best of 3 runs2020.05 | 96.69 | — | — | — | — | |
| SDARTS-RSSearch Space=S2, Search Space Strategy=OFS, Aggregation Protocol=Best of 3 runs, Initial Channels=162020.05 | 96.67 | — | — | — | — | |
| SWABackbone=WRN-28-10, Base Budget=200, Training Budget=1.25 Budgets2018.03 | 96.64 | — | — | — | — | |
| OT-MDRBackbone=Pyramid101, Number of particles=12023.06 | 96.61 | — | — | — | — | |
| RDARTS-ESSearch Space=S2, Search Space Strategy=OFS, Aggregation Protocol=Average of 3 runs2020.05 | 96.59 | — | — | — | — | |
| NoisyDARTSSearch Space=S2, Search Space Strategy=OFS, Aggregation Protocol=Average of 3 runs2020.05 | 96.59 | — | — | — | — | |
| SDARTS-ADVSearch Space=S2, Search Space Strategy=OFS, Aggregation Protocol=Best of 3 runs, Initial Channels=162020.05 | 96.59 | — | — | — | — | |
| SAMBackbone=WRN-28-102024.05 | 96.58 | — | — | — | — | |
| SWABackbone=WRN-28-10, Base Budget=200, Training Budget=1 Budget2018.03 | 96.45 | — | — | — | — | |
| RDARTS-L2Search Space=S4, Search Space Strategy=NFA, Aggregation Protocol=Best of 3 runs2020.05 | 96.44 | — | — | — | — | |
| RDARTS-ADASearch Space=S2, Search Space Strategy=OFS, Aggregation Protocol=Average of 3 runs2020.05 | 96.41 | — | — | — | — | |
| FGEBackbone=WRN-28-10, Base Budget=200, Training Budget=1 Budget2018.03 | 96.36 | — | — | — | — | |
| RDARTS-ESSearch Space=S3, Search Space Strategy=OFS, Aggregation Protocol=Average of 3 runs2020.05 | 96.29 | — | — | — | — | |
| SGD-IREBackbone=WRN-28-102024.05 | 96.24 | — | — | — | — | |
| SAMBackbone=Pyramid101, Number of particles=12023.06 | 96.2 | — | — | — | — | |
| SGDBackbone=WRN-28-10, Base Budget=2002018.03 | 96.18 | — | — | — | — | |
| RDARTS-ADASearch Space=S4, Search Space Strategy=NFA, Aggregation Protocol=Average of 3 runs2020.05 | 96.11 | — | — | — | — | |
| Mixer-S/16-SAMBackbone=Mixer-S/16, SAM Pre-training=true, SAM Fine-tuning=false, Resolution=224x224, Pre-trained on=ImageNet2021.06 | 96.1 | — | — | — | — | |
| WRN 28-10Evaluation Protocol=Supervised and Hybrid2017.03 | 96 | — | — | — | — | |
| DARTSSearch Space=S3, Search Space Strategy=OFS, Aggregation Protocol=Average of 3 runs2020.05 | 95.88 | — | — | — | — | |
| SGDBackbone=WRN-28-102024.05 | 95.84 | — | — | — | — | |
| SWABackbone=ResNet-164, Base Budget=150, Training Budget=1.5 Budgets2018.03 | 95.83 | — | — | — | — | |
| RDARTS-ESSearch Space=S4, Search Space Strategy=NFA, Aggregation Protocol=Average of 3 runs2020.05 | 95.83 | — | — | — | — |