Image Classification on CIFAR-10 (test) (Error Rate & Eigenvalue)
2.05Test Error Ratewrn28/10
Evaluation results
| Method | Links | ||
|---|---|---|---|
| wrn28/10Group=D8 D4 D1, Data Augmentation=AutoAugment2019.11 | 2.05 | — | |
| ProxylessNASParams (M)=5.7, Search Cost (GPU days)=4.0, Search Method=gradient, Backbone=PyramidNet2020.06 | 2.08 | — | |
| ProxylessNASParams (M)=5.7, Search Cost (GPU days)=4.0, Search Method=gradient, Backbone=PyramidNet2021.02 | 2.08 | — | |
| wrn28/10*Group=D8 D4 D1, Data Augmentation=AutoAugment, parameter_constrained=true2019.11 | 2.39 | — | |
| P-DARTSParams (M)=3.4, Search Cost (GPU days)=0.3, Search Method=gradient2020.06 | 2.5 | — | |
| P-DARTSParams (M)=3.4, Search Cost (GPU days)=0.3, Search Method=gradient2021.02 | 2.5 | — | |
| PC-DARTSParams (M)=3.6, Search Cost (GPU days)=0.1, Search Method=gradient2021.02 | 2.57 | — | |
| wrn28/10Group=None (non-equivariant baseline), Data Augmentation=AutoAugment2019.11 | 2.6 | — | |
| SDARTS-ADVParams (M)=3.3, Search Cost (GPU days)=1.3, Search Method=gradient2021.02 | 2.61 | — | |
| TE-NASParams (M)=3.8, Search Cost (GPU days)=0.05, Search Method=training-free2021.02 | 2.63 | — | |
| DARTS- (ours)Search Space=S32020.09 | 2.65 | 0.31 | |
| NASNet-AParams (M)=3.3, Search Cost (GPU days)=2000, Search Method=RL2020.06 | 2.65 | — | |
| NASNet-AParams (M)=3.3, Search Cost (GPU days)=2000, Search Method=RL2021.02 | 2.65 | — | |
| DARTS- (ours)Search Space=S12020.09 | 2.76 | 0.37 | |
| DARTS (2nd)Params (M)=3.3, Search Cost (GPU days)=1.0, Search Method=gradient2021.02 | 2.76 | — | |
| DARTS- (ours)Search Space=S22020.09 | 2.79 | 0.41 | |
| BayesNASParams (M)=3.4, Search Cost (GPU days)=0.2, Search Method=gradient2021.02 | 2.81 | — | |
| GDASParams (M)=2.5, Search Cost (GPU days)=0.17, Search Method=gradient2021.02 | 2.82 | — | |
| SNASParams (M)=2.8, Search Cost (GPU days)=1.5, Search Method=gradient2021.02 | 2.85 | — | |
| ENASParams (M)=4.6, Search Cost (GPU days)=0.5, Search Method=RL2020.06 | 2.89 | — | |
| ENASParams (M)=4.6, Search Cost (GPU days)=0.5, Search Method=RL2021.02 | 2.89 | — | |
| DARTS- (ours)Search Space=S42020.09 | 2.91 | 0.3 | |
| wrn28/10Group=D8 D4 D4, Data Augmentation=Standard2019.11 | 2.91 | — | |
| GDASParams (M)=3.4, Search Cost (GPU days)=0.3, Search Method=gradient2020.06 | 2.93 | — | |
| DARTS-ADASearch Space=S32020.09 | 2.99 | — | |
| DARTS (1st)Params (M)=3.3, Search Cost (GPU days)=0.4, Search Method=gradient2021.02 | 3 | — | |
| DARTS-ADASearch Space=S12020.09 | 3.03 | — | |
| DARTS-ESSearch Space=S12020.09 | 3.05 | — | |
| wrn28/10Group=D8 D4 D1, Data Augmentation=Standard2019.11 | 3.13 | — | |
| wrn28/10Group=C8 C4 C1, Data Augmentation=Standard2019.11 | 3.2 | — | |
| wrn28/10*Group=D8 D4 D1, Data Augmentation=Standard, parameter_constrained=true2019.11 | 3.28 | — | |
| AmoebaNet-AParams (M)=3.2, Search Cost (GPU days)=3150, Search Method=evolution2021.02 | 3.34 | — | |
| wrn28/10Group=D1 D1 D1, Data Augmentation=Standard2019.11 | 3.36 | — | |
| DARTS-ESSearch Space=S22020.09 | 3.41 | — | |
| PNASParams (M)=3.2, Search Cost (GPU days)=225, Search Method=SMBO, Data Augmentation=No cutout2021.02 | 3.41 | — | |
| DenseNet-BCParams (M)=25.6, Search Cost (GPU days)=manual, Search Method=manual, Cutout Augmentation=false2020.06 | 3.46 | — | |
| DARTS-ADASearch Space=S22020.09 | 3.59 | — | |
| DARTS-ESSearch Space=S32020.09 | 3.71 | — | |
| wrn28/10Group=None (non-equivariant baseline), Data Augmentation=Standard2019.11 | 3.87 | — | |
| DARTS-ADASearch Space=S42020.09 | 3.89 | — | |
| Meta PLLabeled instances=4000, fair_comparison=false2021.06 | 3.89 | — | |
| DARTSSearch Space=S32020.09 | 4.12 | — | |
| DARTS-ESSearch Space=S42020.09 | 4.17 | — | |
| FixMatch (RA) + CMW-NetNumber of labels=40002022.02 | 4.25 | — | |
| FixMatch (RA)Number of labels=40002022.02 | 4.26 | — | |
| FixMatch (CTA)Labeled instances=40002021.06 | 4.31 | — | |
| ReRankMatchLabeled instances=40002021.06 | 4.4 | — | |
| DARTSSearch Space=S22020.09 | 4.42 | — | |
| CSSL (CTA)Labeled instances=40002021.06 | 4.43 | — | |
| DARTSSearch Space=S12020.09 | 4.66 | — | |
| ReMixMatchLabeled instances=40002021.06 | 4.72 | — | |
| FixMatch (RA) + CMW-NetNumber of labels=2502022.02 | 4.73 | — | |
| UDALabeled instances=40002021.06 | 4.88 | — | |
| CoMatchLabeled instances=2502021.06 | 4.91 | — | |
| AlphaMatchLabeled instances=2502021.06 | 4.97 | — | |
| BOHNASSearch Space=hierarchical-variant, Selection=Best across three seeds2022.11 | 5.02 | — | |
| FixMatch (CTA)Labeled instances=2502021.06 | 5.07 | — | |
| FixMatch (RA)Number of labels=2502022.02 | 5.07 | — | |
| EnAETLabeled instances=40002021.06 | 5.35 | — | |
| BOHNASSearch Space=hierarchical-variant, Selection=Mean2022.11 | 5.37 | — | |
| ReMixMatchLabeled instances=2502021.06 | 5.44 | — | |
| CSSL (CTA)Labeled instances=2502021.06 | 5.48 | — | |
| NAS-Bench-201 oracleSearch Space=cell-based2022.11 | 5.63 | — | |
| DrNASSearch Space=cell-based2022.11 | 5.64 | — | |
| BOHNASSearch Space=cell-based, Selection=Best across three seeds2022.11 | 5.64 | — | |
| BOHNASSearch Space=hierarchical, Selection=Best across three seeds2022.11 | 5.65 | — | |
| NASBOWLSearch Space=cell-based2022.11 | 5.68 | — | |
| BOHNASSearch Space=cell-based, Selection=Mean2022.11 | 5.68 | — | |
| RESearch Space=cell-based2022.11 | 5.76 | — | |
| BOHNASSearch Space=hierarchical, Selection=Mean2022.11 | 6 | — | |
| ReRankMatchLabeled instances=2502021.06 | 6.02 | — | |
| AREASearch Space=hierarchical2022.11 | 6.37 | — | |
| RSSearch Space=cell-based2022.11 | 6.39 | — | |
| MixMatchLabeled instances=40002021.06 | 6.42 | — | |
| ResNetSearch Space=cell-based, Backbone=ResNet-322022.11 | 6.49 | — | |
| CSSL (CTA)Labeled instances=402021.06 | 6.5 | — | |
| NASWOTSearch Space=cell-based, N=102022.11 | 6.55 | — | |
| NASWOTSearch Space=cell-based, N=1002022.11 | 6.59 | — | |
| NASWOTSearch Space=cell-based, N=10002022.11 | 6.68 | — | |
| NASBOTSearch Space=hierarchical2022.11 | 6.68 | — | |
| RSSearch Space=hierarchical2022.11 | 6.77 | — | |
| RESearch Space=hierarchical2022.11 | 6.88 | — | |
| CoMatchLabeled instances=402021.06 | 6.91 | — | |
| DARTSSearch Space=S42020.09 | 6.95 | — | |
| NASWOTSearch Space=cell-based, N=100002022.11 | 6.98 | — | |
| NASBOWLSearch Space=hierarchical2022.11 | 6.98 | — | |
| EnAETLabeled instances=2502021.06 | 7.6 | — | |
| NASWOTSearch Space=hierarchical, N=102022.11 | 8.18 | — | |
| NASWOTSearch Space=hierarchical, N=10002022.11 | 8.26 | — | |
| NASWOTSearch Space=hierarchical, N=100002022.11 | 8.4 | — | |
| NASWOTSearch Space=hierarchical, N=1002022.11 | 8.56 | — | |
| AlphaMatchLabeled instances=402021.06 | 8.65 | — | |
| UDALabeled instances=2502021.06 | 8.82 | — | |
| Mean TeacherLabeled instances=40002021.06 | 9.19 | — | |
| FixMatch (RA) + CMW-NetNumber of labels=402022.02 | 9.6 | — | |
| MixMatchLabeled instances=2502021.06 | 11.05 | — | |
| FixMatch (CTA)Labeled instances=402021.06 | 11.39 | — | |
| EfficientNetSearch Space=cell-based, Variant=B02022.11 | 11.73 | — | |
| FixMatch (RA)Number of labels=402022.02 | 13.81 | — | |
| ReRankMatchLabeled instances=402021.06 | 18.25 | — |