Image Classification on ImageNet Mobile Setting (test)
23.7Top-1 ErrorDrNAS
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| DrNASParams (M)=5.7, Search Cost (GPU days)=4.6, Search Method=gradient, Search Dataset=ImageNet2020.06 | 23.7 | 7.1 | |
| DrNASSearch strategy=gradient, Params=5.7M, Search cost=4.6 GPU days, Search dataset=ImageNet2022.11 | 23.7 | 7.1 | |
| NSGANetV1-A3Params (M)=5.0, GPU=8 2080Ti, Search Cost (GPU Days)=27, Search Method=Evolution, Evaluation Protocol=Predictor, Year=TEC20202022.04 | 23.8 | 7 | |
| DARTS+Paradigm=partial-channel, Params (M)=5.1, FLOPS (M)=5822022.08 | 23.9 | 7.4 | |
| RF-PCDARTSParadigm=partial-channel, Params (M)=5.4, FLOPS (M)=6002022.08 | 23.9 | 7.1 | |
| Shapley-NASSearch strategy=gradient, Params=5.4M, Search cost=4.2 GPU days, Search dataset=ImageNet2022.11 | 23.9 | — | |
| GAEA + PC-DARTSParams (M)=5.6, Search Cost (GPU days)=3.8, Search Method=gradient, Search Dataset=ImageNet2020.06 | 24 | 7.3 | |
| PRE-NASParams (M)=6.2, GPU=1 V100, Search Cost (GPU Days)=0.6, Search Method=Evolution, Evaluation Protocol=Predictor+w/i, Search Space=DARTS2022.04 | 24 | 7.8 | |
| SGAS (Cri.2 best)Params (M)=5.4, Multiply-Add operations (M)=598, Search Cost (GPU-days)=0.25, Search Method=gradient2019.11 | 24.1 | 7.3 | |
| UNNAS-jigParams (M)=5.2, FLOPS(M)=567, Search Cost (GPU days)=2, Searched Method=gradient-based, Searched dataset=ImageNet2021.08 | 24.1 | — | |
| RLNASParadigm=single-path, Params (M)=5.5, FLOPS (M)=5972022.08 | 24.1 | 7.1 | |
| PC-DARTS (ImageNet)+Params (M)=5.3, Mult-Adds (M)=597, Search Cost (GPU-days)=3.8, Search Method=gradient-based, Search Dataset=ImageNet2019.07 | 24.2 | 7.3 | |
| SGAS (Cri.1 best)Params (M)=5.3, Multiply-Add operations (M)=585, Search Cost (GPU-days)=0.25, Search Method=gradient2019.11 | 24.2 | 7.2 | |
| PC-DARTS (ImageNet)Params (M)=5.3, Search Cost (GPU days)=3.8, Search Method=gradient, Search Dataset=ImageNet2020.06 | 24.2 | 7.3 | |
| DrNAS (without progressive learning)Params (M)=5.2, Search Cost (GPU days)=3.9, Search Method=gradient, Search Dataset=ImageNet2020.06 | 24.2 | 7.3 | |
| PC-DARTS (ImageNet)Params (M)=5.3, Search Cost (GPU days)=3.8, Search Method=gradient, Search Dataset=ImageNet2021.02 | 24.2 | 7.3 | |
| PC-DARTSParams (M)=5.3, FLOPS(M)=597, Search Cost (GPU days)=3.8, Searched Method=gradient-based, Searched dataset=ImageNet2021.08 | 24.2 | 7.3 | |
| PC-DARTSParadigm=partial-channel, Params (M)=5.3, FLOPS (M)=5972022.08 | 24.2 | 7.3 | |
| AmoebaNet-CParams (M)=6.4, +x (M)=570, Search Cost (GPU days)=3150, Search Method=evolution2018.06 | 24.3 | 7.6 | |
| AmoebaNet-CType=Micro search space, Venue=AAAI19, GPUs=450, Times (days)=7, Params (million)=6.4, +x (million)=5702019.10 | 24.3 | 7.6 | |
| AmoebaNet-CParams (M)=6.4, Mult-Adds (M)=570, Search Cost (GPU-days)=3150, Search Method=evolution2019.07 | 24.3 | 7.6 | |
| AmoebaNet-CParams (M)=6.4, Multiply-Add operations (M)=570, Search Cost (GPU-days)=3150, Search Method=evolution2019.11 | 24.3 | 7.6 | |
| AmoebaNet-CParams (M)=6.4, Search Cost (GPU days)=3150, Search Method=evolution, Search Dataset=CIFAR-102020.06 | 24.3 | 7.6 | |
| AmoebaNet-CParams (M)=6.4, Search Cost (GPU days)=3150, Search Method=evolution, Search Dataset=CIFAR-102021.02 | 24.3 | 7.6 | |
| AmoebaNet-CParams (M)=6.4, FLOPS(M)=570, Search Cost (GPU days)=3150, Searched Method=evolution, Searched dataset=CIFAR-102021.08 | 24.3 | 7.6 | |
| GenNAS-D14Params (M)=5.3, FLOPS(M)=599, Search Cost (GPU days)=0.7*+0.04, Searched Method=evolution+few-shot, Searched dataset=CIFAR-102021.08 | 24.3 | 7.2 | |
| AmoebaNet-CSearch strategy=evolution, Params=6.4M, Search cost=3150 GPU days, Search dataset=CIFAR-102022.11 | 24.3 | 7.6 | |
| DrNASSearch strategy=gradient, Params=5.7M, Search cost=N/A, Search dataset=ImageNet, reproduced=true2022.11 | 24.3 | 7.4 | |
| Shapley-NASSearch strategy=gradient, Params=5.1M, Search cost=0.3 GPU days, Search dataset=CIFAR-102022.11 | 24.3 | 7.6 | |
| SGAS (Cri.2 avg.)Params (M)=5.4, Multiply-Add operations (M)=597, Search Cost (GPU-days)=0.25, Search Method=gradient2019.11 | 24.38 | 7.39 | |
| P-DARTS (CIFAR10)Params (M)=4.9, Mult-Adds (M)=557, Search Cost (GPU-days)=0.3, Search Method=gradient-based2019.07 | 24.4 | 7.4 | |
| P-DARTSParams (M)=4.9, Multiply-Add operations (M)=557, Search Cost (GPU-days)=0.3, Search Method=gradient2019.11 | 24.4 | 7.4 | |
| P-DARTS (CIFAR-10)Params (M)=4.9, Search Cost (GPU days)=0.3, Search Method=gradient, Search Dataset=CIFAR-102020.06 | 24.4 | 7.4 | |
| P-DARTS (CIFAR-10)Params (M)=4.9, Search Cost (GPU days)=0.3, Search Method=gradient, Search Dataset=CIFAR-102021.02 | 24.4 | 7.4 | |
| P-DARTSParams (M)=4.9, FLOPS(M)=557, Search Cost (GPU days)=0.3, Searched Method=gradient-based, Searched dataset=CIFAR-102021.08 | 24.4 | 7.4 | |
| P-DARTSParams (M)=4.9, Search Cost (GPU Days)=0.3, Search Method=Gradient, Evaluation Protocol=One-shot, Year=ICCV2019, Search Space=DARTS2022.04 | 24.4 | 7.4 | |
| EVNASParams (M)=5.1, GPU=1 2080 Ti, Search Cost (GPU Days)=3.83, Search Method=Evolution, Evaluation Protocol=One-shot, Year=GECCO2021, Search Space=DARTS2022.04 | 24.4 | 7.4 | |
| P-DARTSSearch strategy=gradient, Params=4.9M, Search cost=0.3 GPU days, Search dataset=CIFAR-102022.11 | 24.4 | 7.4 | |
| SGAS (Cri.1 avg.)Params (M)=5.3, Multiply-Add operations (M)=579, Search Cost (GPU-days)=0.25, Search Method=gradient2019.11 | 24.41 | 7.29 | |
| BOHNAS (best)Search strategy=BO, Params=5.4M, Search cost=8 GPU days, Search dataset=CIFAR-102022.11 | 24.48 | 7.3 | |
| TE-NASParams (M)=5.4, Search Cost (GPU days)=0.17, Search Method=training-free, Search Dataset=ImageNet2021.02 | 24.5 | 7.5 | |
| TE-NASParams (M)=5.4, FLOPS(M)=599, Search Cost (GPU days)=0.17, Searched Method=training-free, Searched dataset=ImageNet2021.08 | 24.5 | 7.5 | |
| TE-NASParadigm=training-free, Params (M)=5.4, FLOPS (M)=5912022.08 | 24.5 | 7.5 | |
| BONAS-CSearch strategy=BO, Params=5.1M, Search cost=7.5 GPU days, Search dataset=CIFAR-102022.11 | 24.6 | 7.5 | |
| P-DARTSSearch strategy=gradient, Params=4.9M, Search cost=N/A, Search dataset=CIFAR-10, reproduced=true2022.11 | 24.6 | 7.5 | |
| P-DARTS (CIFAR100)Params (M)=5.1, Mult-Adds (M)=577, Search Cost (GPU-days)=0.3, Search Method=gradient-based2019.07 | 24.7 | 7.5 | |
| FairNAS-AParams (M)=4.6, Multiply-Add operations (M)=388, Search Cost (GPU-days)=12, Search Method=evolution2019.11 | 24.7 | 7.6 | |
| P-DARTS (CIFAR-100)Params (M)=5.1, Search Cost (GPU days)=0.3, Search Method=gradient, Search Dataset=CIFAR-1002020.06 | 24.7 | 7.5 | |
| P-DARTS (CIFAR-100)Params (M)=5.1, Search Cost (GPU days)=0.3, Search Method=gradient, Search Dataset=CIFAR-1002021.02 | 24.7 | 7.5 | |
| P-DARTSParams (M)=5.1, FLOPS(M)=577, Search Cost (GPU days)=0.3, Searched Method=gradient-based, Searched dataset=CIFAR-1002021.08 | 24.7 | 7.5 | |
| CARSParams (M)=5.1, Search Cost (GPU Days)=0.4, Search Method=Evolution, Evaluation Protocol=One-shot, Year=CVPR2020, Search Space=DARTS2022.04 | 24.8 | 7.5 | |
| ProxylessNAS (GPU)Params (M)=7.1, Mult-Adds (M)=465, Search Cost (GPU-days)=8.3, Search Method=gradient-based2019.07 | 24.9 | 7.5 | |
| ProxylessNASParams (M)=7.1, Multiply-Add operations (M)=465, Search Cost (GPU-days)=8.3, Search Method=gradient2019.11 | 24.9 | 7.5 | |
| ProxylessNAS (GPU)Params (M)=7.1, Search Cost (GPU days)=8.3, Search Method=gradient, Search Dataset=ImageNet2020.06 | 24.9 | 7.5 | |
| ProxylessNAS (GPU)Params (M)=7.1, Search Cost (GPU days)=8.3, Search Method=gradient, Search Dataset=ImageNet2021.02 | 24.9 | 7.5 | |
| ProxylessNASParams (M)=7.1, FLOPS(M)=465, Search Cost (GPU days)=8.3, Searched Method=gradient-based, Searched dataset=ImageNet2021.08 | 24.9 | 7.5 | |
| Shapley-NASSearch strategy=gradient, Params=5.1M, Search cost=N/A, Search dataset=CIFAR-10, reproduced=true2022.11 | 24.9 | 7.6 | |
| Shapley-NASSearch strategy=gradient, Params=5.4M, Search cost=N/A, Search dataset=ImageNet, reproduced=true2022.11 | 25 | 7.6 | |
| ShuffleNet 2x (v2)Params (M)=~5, Mult-Adds (M)=591, Search Method=manual2019.07 | 25.1 | — | |
| PC-DARTS (CIFAR10)Params (M)=5.3, Mult-Adds (M)=586, Search Cost (GPU-days)=0.1, Search Method=gradient-based2019.07 | 25.1 | 7.8 | |
| ShuffleNet 2x (v2)Params (M)=~5, Multiply-Add operations (M)=591, Search Cost (GPU-days)=manual, Search Method=manual2019.11 | 25.1 | — | |
| PC-DARTSParams (M)=5.3, Multiply-Add operations (M)=586, Search Cost (GPU-days)=0.1, Search Method=gradient2019.11 | 25.1 | 7.8 | |
| ShuffleNet 2x (v2)Params (M)=~5, Search Method=manual2020.06 | 25.1 | — | |
| PC-DARTS (CIFAR-10)Params (M)=5.3, Search Cost (GPU days)=0.1, Search Method=gradient, Search Dataset=CIFAR-102020.06 | 25.1 | 7.8 | |
| PC-DARTS (CIFAR-10)Params (M)=5.3, Search Cost (GPU days)=0.1, Search Method=gradient, Search Dataset=CIFAR-102021.02 | 25.1 | 7.8 | |
| PC-DARTSParams (M)=5.3, FLOPS(M)=586, Search Cost (GPU days)=0.1, Searched Method=gradient-based, Searched dataset=CIFAR-102021.08 | 25.1 | 7.8 | |
| GenNAS-comboParams (M)=4.8, FLOPS(M)=559, Search Cost (GPU days)=0.04, Searched Method=evolution+few-shot, Searched dataset=CIFAR-102021.08 | 25.1 | 7.8 | |
| FreeNASParadigm=training-free, Params (M)=3.6, FLOPS (M)=5922022.08 | 25.1 | 7.8 | |
| ShuffleNet 2x (v2)Type=manual, Params=~5M, Search cost=N/A, Search dataset=CIFAR-102022.11 | 25.1 | — | |
| PC-DARTSSearch strategy=gradient, Params=3.6M, Search cost=0.1 GPU days, Search dataset=CIFAR-102022.11 | 25.1 | 7.8 | |
| MnasNet-92Params (M)=4.4, Mult-Adds (M)=388, Search Method=RL2019.07 | 25.2 | 8 | |
| MnasNet-92Params (M)=4.4, Multiply-Add operations (M)=388, Search Method=RL2019.11 | 25.2 | 8 | |
| MnasNet-92Params (M)=4.4, Search Method=RL, Search Dataset=CIFAR-102020.06 | 25.2 | 8 | |
| MnasNet-92Params (M)=4.4, Search Method=RL, Search Dataset=CIFAR-102021.02 | 25.2 | 8 | |
| EcoNASParams (M)=4.3, GPU=1 1080Ti, Search Cost (GPU Days)=8, Search Method=Evolution, Evaluation Protocol=Conventional, Year=CVPR2020, Search Space=DARTS2022.04 | 25.2 | — | |
| MnasNet-92Search strategy=RL, Params=4.4M, Search cost=not reported, Search dataset=CIFAR-102022.11 | 25.2 | 8 | |
| TreeCell-B with CondenseNetG1=4, G3=8, Multiply-add operations (x+)=594M2018.06 | 25.4 | 8.1 | |
| BONAS-DSearch strategy=BO, Params=4.8M, Search cost=10 GPU days, Search dataset=CIFAR-102022.11 | 25.4 | 8 | |
| TreeCell-A with CondenseNetG1=4, G3=8, Multiply-add operations (x+)=588M2018.06 | 25.5 | 8 | |
| AmoebaNet-AParams (M)=5.1, +x (M)=555, Search Cost (GPU days)=3150, Search Method=evolution2018.06 | 25.5 | 8 | |
| AmoebaNet-AType=Micro search space, Venue=AAAI19, GPUs=450, Times (days)=7, Params (million)=5.1, +x (million)=5552019.10 | 25.5 | 8 | |
| AmoebaNet-AParams (M)=5.1, Multiply-Add operations (M)=555, Search Cost (GPU-days)=3150, Search Method=evolution2019.11 | 25.5 | 8 | |
| AmoebaNet-AParams (M)=5.1, GPU=450 K40, Search Cost (GPU Days)=3150, Search Method=Evolution, Evaluation Protocol=Conventional, Year=AAAI20192022.04 | 25.5 | 8 | |
| SPOSParadigm=single-path, Params (M)=4.6, FLOPS (M)=5122022.08 | 25.5 | 7.9 | |
| DSNASSearch Method=gradient, Search Dataset=ImageNet2020.06 | 25.7 | 8.1 | |
| PNASParams (M)=5.1, +x (M)=588, Search Cost (GPU days)=~225, Search Method=SMBO2018.06 | 25.8 | 8.1 | |
| Progressive NASType=Micro search space, Venue=ECCV18, GPUs=100, Times (days)=1.5, Params (million)=5.1, +x (million)=5882019.10 | 25.8 | 8.1 | |
| PNASParams (M)=5.1, Mult-Adds (M)=588, Search Cost (GPU-days)=225, Search Method=SMBO2019.07 | 25.8 | 8.1 | |
| PNASParams (M)=5.1, Multiply-Add operations (M)=588, Search Cost (GPU-days)=225, Search Method=SMBO2019.11 | 25.8 | 8.1 | |
| PNASParams (M)=5.1, Search Cost (GPU days)=225, Search Method=SMBO, Search Dataset=CIFAR-102020.06 | 25.8 | 8.1 | |
| PNASParams (M)=5.1, Search Cost (GPU days)=225, Search Method=SMBO, Search Dataset=CIFAR-102021.02 | 25.8 | 8.1 | |
| PNASParams (M)=5.1, FLOPS(M)=588, Search Cost (GPU days)=225, Searched Method=SMBO, Searched dataset=CIFAR-102021.08 | 25.8 | 8.1 | |
| PNASParams (M)=5.1, Search Cost (GPU Days)=225, Search Method=SMBO, Evaluation Protocol=Predictor, Year=ECCV20182022.04 | 25.8 | 8.1 | |
| PNASSearch strategy=BO, Params=5.1M, Search cost=255 GPU days, Search dataset=CIFAR-102022.11 | 25.8 | 8.1 | |
| NASNet-AN=4, Multiply-add operations (x+)=564M2018.06 | 26 | 8.4 | |
| NASNet-AParams (M)=5.3, +x (M)=564, Search Cost (GPU days)=2000, Search Method=RL2018.06 | 26 | 8.4 | |
| AmoebaNet-BParams (M)=5.3, +x (M)=555, Search Cost (GPU days)=3150, Search Method=evolution2018.06 | 26 | 8.5 | |
| NASNet-AType=Micro search space, Venue=CVPR18, GPUs=450, Times (days)=3-4, Params (million)=5.3, +x (million)=5642019.10 | 26 | 8.4 | |
| AmoebaNet-BType=Micro search space, Venue=AAAI19, GPUs=450, Times (days)=7, Params (million)=5.3, +x (million)=5552019.10 | 26 | 8.5 | |
| GDAS [C=50,N=4]Type=Micro search space, Venue=CVPR19, GPUs=1, Times (days)=0.21, Params (million)=5.3, +x (million)=5812019.10 | 26 | 8.5 |