Image Classification on CIFAR10 (test) (Error Rate)
0.116Error RateEM routing
Evaluation Results
| Method | Links | |
|---|---|---|
| EM routingResolution=32x32, Architecture=4 capsule layers, Ensemble size=52018.05 | 0.116 | |
| FREMResolution=32x32, Architecture=4 capsule layers, Ensemble size=52018.05 | 0.143 | |
| FRMSResolution=32x32, Architecture=4 capsule layers, Ensemble size=52018.05 | 0.156 | |
| Baseline CNNResolution=32x32, Architecture=4 capsule layers, Ensemble size=52018.05 | 0.192 | |
| UniformAugment (UA)Model=SS (26 2x96d)2020.03 | 1.9 | |
| AutoAugment (AA)Model=SS (26 2x96d)2020.03 | 2 | |
| PBAModel=SS (26 2x96d)2020.03 | 2 | |
| Fast AutoAugment (FAA)Model=SS (26 2x96d)2020.03 | 2 | |
| RandAugment (RA)Model=SS (26 2x96d)2020.03 | 2 | |
| ProxylessNAS + cutoutSearch Cost (GPU-days)=4, Search Method=gradient-based2019.07 | 2.08 | |
| UniformAugment (UA)Model=SS (26 2x32d)2020.03 | 2.49 | |
| P-DARTS + cutoutParams (M)=3.4, Search Cost (GPU-days)=0.3, Search Method=gradient-based2019.07 | 2.5 | |
| AutoAugment (AA)Model=SS (26 2x32d)2020.03 | 2.5 | |
| PBAModel=SS (26 2x32d)2020.03 | 2.5 | |
| Fast AutoAugment (FAA)Model=SS (26 2x32d)2020.03 | 2.5 | |
| AmoebaNet-B + cutoutParams (M)=2.8, Search Cost (GPU-days)=3150, Search Method=evolution2019.07 | 2.55 | |
| PC-DARTS + cutoutParams (M)=3.6, Search Cost (GPU-days)=0.1, Search Method=gradient-based2019.07 | 2.57 | |
| AutoAugment (AA)Model=WRN-28-102020.03 | 2.6 | |
| PBAModel=WRN-28-102020.03 | 2.6 | |
| CutoutModel=SS (26 2x96d)2020.03 | 2.6 | |
| NASNet-A + cutoutParams (M)=3.3, Search Cost (GPU-days)=1800, Search Method=RL2019.07 | 2.65 | |
| UniformAugment (UA)Model=WRN-28-102020.03 | 2.67 | |
| Fast AutoAugment (FAA)Model=WRN-28-102020.03 | 2.7 | |
| RandAugment (RA)Model=WRN-28-102020.03 | 2.7 | |
| DARTS (2nd order) + cutoutParams (M)=3.3, Search Cost (GPU-days)=1, Search Method=gradient-based2019.07 | 2.76 | |
| BayesNAS + cutoutParams (M)=3.4, Search Cost (GPU-days)=0.2, Search Method=gradient-based2019.07 | 2.81 | |
| SNAS (moderate) + cutoutParams (M)=2.8, Search Cost (GPU-days)=1.5, Search Method=gradient-based2019.07 | 2.85 | |
| ENAS + cutoutParams (M)=4.6, Search Cost (GPU-days)=0.5, Search Method=RL2019.07 | 2.89 | |
| BaselineModel=SS (26 2x96d)2020.03 | 2.9 | |
| DARTS (1st order) + cutoutParams (M)=3.3, Search Cost (GPU-days)=0.4, Search Method=gradient-based2019.07 | 3 | |
| CutoutModel=SS (26 2x32d)2020.03 | 3 | |
| CutoutModel=WRN-28-102020.03 | 3.1 | |
| PNASParams (M)=3.2, Search Cost (GPU-days)=225, Search Method=SMBO2019.07 | 3.41 | |
| DenseNet-BCParams (M)=25.6, Search Method=manual2019.07 | 3.46 | |
| Drop-ActivationBackbone=DenseNet190-402018.11 | 3.51 | |
| NAONet-WSParams (M)=3.1, Search Cost (GPU-days)=0.4, Search Method=NAO2019.07 | 3.53 | |
| Fast AutoAugment (FAA)Model=WRN-40-22020.03 | 3.6 | |
| BaselineModel=SS (26 2x32d)2020.03 | 3.6 | |
| AutoAugment (AA)Model=WRN-40-22020.03 | 3.7 | |
| Drop-ActivationBackbone=WideResNet28-102018.11 | 3.74 | |
| Hireachical EvolutionParams (M)=15.7, Search Cost (GPU-days)=300, Search Method=evolution2019.07 | 3.75 | |
| UniformAugment (UA)Model=WRN-40-22020.03 | 3.75 | |
| RReLUBackbone=DenseNet190-402018.11 | 3.84 | |
| BaselineBackbone=WideResNet28-102018.11 | 3.85 | |
| BaselineModel=WRN-28-102020.03 | 3.9 | |
| BaselineBackbone=DenseNet190-402018.11 | 3.91 | |
| BaselineBackbone=ResNeXt29-8x642018.11 | 3.95 | |
| Drop-ActivationBackbone=ResNeXt29-8x642018.11 | 3.95 | |
| DenseNetDepth=100, # params=7.0M2019.05 | 4.1 | |
| CutoutModel=WRN-40-22020.03 | 4.1 | |
| OSNetDepth=210, # params=4.6M2019.05 | 4.18 | |
| RReLUBackbone=WideResNet28-102018.11 | 4.32 | |
| Drop-ActivationBackbone=DenseNet100-122018.11 | 4.38 | |
| OSNetDepth=78, # params=2.2M2019.05 | 4.41 | |
| RReLUBackbone=ResNeXt29-8x642018.11 | 4.56 | |
| BaselineBackbone=DenseNet100-122018.11 | 4.73 | |
| Wide ResNetDepth=16, # params=11.0M2019.05 | 4.81 | |
| Drop-ActivationBackbone=PreResNet1642018.11 | 4.87 | |
| pre-act ResNetDepth=1001, # params=10.2M2019.05 | 4.92 | |
| Wide ResNetDepth=40, # params=8.9M2019.05 | 4.97 | |
| BaselineBackbone=PreResNet1642018.11 | 5.01 | |
| RReLUBackbone=DenseNet100-122018.11 | 5.06 | |
| RReLUBackbone=PreResNet1642018.11 | 5.17 | |
| DenseNetDepth=40, # params=1.0M2019.05 | 5.24 | |
| pre-act ResNetDepth=164, # params=1.7M2019.05 | 5.46 | |
| BaselineModel=WRN-40-22020.03 | 5.6 | |
| Drop-ActivationBackbone=ResNet1642018.11 | 5.62 | |
| BaselineBackbone=ResNet1642018.11 | 5.94 | |
| RReLUBackbone=ResNet1642018.11 | 6.08 | |
| Drop-ActivationBackbone=ResNet1102018.11 | 6.25 | |
| Drop-ActivationBackbone=VGG19(BN)2018.11 | 6.38 | |
| BaselineBackbone=VGG19(BN)2018.11 | 6.56 | |
| RReLUBackbone=VGG19(BN)2018.11 | 6.6 | |
| BaselineBackbone=ResNet1102018.11 | 6.77 | |
| RReLUBackbone=ResNet1102018.11 | 7.37 | |
| NASBOTSearch budget=10 hours, Training iterations=60K2018.02 | 12.09 | |
| RANDSearch budget=10 hours, Training iterations=60K2018.02 | 13.42 | |
| EASearch budget=10 hours, Training iterations=60K2018.02 | 14.11 | |
| TreeBOSearch budget=10 hours, Training iterations=60K2018.02 | 15.33 | |
| VGG-19Training iterations=60K2018.02 | 17.18 |