List your company
ResearchFormerly WizWand

Image Classification on ImageNet Mobile Setting (test)

23.7Top-1 ErrorDrNAS
23.60824.22924.8525.471Jun 7, 2018Mar 2, 2019Nov 25, 2019Aug 20, 2020May 15, 2021Feb 7, 2022Nov 3, 2022
Updated 8mo ago

Evaluation results

MethodLinks
DrNASParams (M)=5.7, Search Cost (GPU days)=4.6, Search Method=gradient, Search Dataset=ImageNet2020.0623.77.1
DrNASSearch strategy=gradient, Params=5.7M, Search cost=4.6 GPU days, Search dataset=ImageNet2022.1123.77.1
NSGANetV1-A3Params (M)=5.0, GPU=8 2080Ti, Search Cost (GPU Days)=27, Search Method=Evolution, Evaluation Protocol=Predictor, Year=TEC20202022.0423.87
DARTS+Paradigm=partial-channel, Params (M)=5.1, FLOPS (M)=5822022.0823.97.4
RF-PCDARTSParadigm=partial-channel, Params (M)=5.4, FLOPS (M)=6002022.0823.97.1
Shapley-NASSearch strategy=gradient, Params=5.4M, Search cost=4.2 GPU days, Search dataset=ImageNet2022.1123.9—
GAEA + PC-DARTSParams (M)=5.6, Search Cost (GPU days)=3.8, Search Method=gradient, Search Dataset=ImageNet2020.06247.3
PRE-NASParams (M)=6.2, GPU=1 V100, Search Cost (GPU Days)=0.6, Search Method=Evolution, Evaluation Protocol=Predictor+w/i, Search Space=DARTS2022.04247.8
SGAS (Cri.2 best)Params (M)=5.4, Multiply-Add operations (M)=598, Search Cost (GPU-days)=0.25, Search Method=gradient2019.1124.17.3
UNNAS-jigParams (M)=5.2, FLOPS(M)=567, Search Cost (GPU days)=2, Searched Method=gradient-based, Searched dataset=ImageNet2021.0824.1—
RLNASParadigm=single-path, Params (M)=5.5, FLOPS (M)=5972022.0824.17.1
PC-DARTS (ImageNet)+Params (M)=5.3, Mult-Adds (M)=597, Search Cost (GPU-days)=3.8, Search Method=gradient-based, Search Dataset=ImageNet2019.0724.27.3
SGAS (Cri.1 best)Params (M)=5.3, Multiply-Add operations (M)=585, Search Cost (GPU-days)=0.25, Search Method=gradient2019.1124.27.2
PC-DARTS (ImageNet)Params (M)=5.3, Search Cost (GPU days)=3.8, Search Method=gradient, Search Dataset=ImageNet2020.0624.27.3
DrNAS (without progressive learning)Params (M)=5.2, Search Cost (GPU days)=3.9, Search Method=gradient, Search Dataset=ImageNet2020.0624.27.3
PC-DARTS (ImageNet)Params (M)=5.3, Search Cost (GPU days)=3.8, Search Method=gradient, Search Dataset=ImageNet2021.0224.27.3
PC-DARTSParams (M)=5.3, FLOPS(M)=597, Search Cost (GPU days)=3.8, Searched Method=gradient-based, Searched dataset=ImageNet2021.0824.27.3
PC-DARTSParadigm=partial-channel, Params (M)=5.3, FLOPS (M)=5972022.0824.27.3
AmoebaNet-CParams (M)=6.4, +x (M)=570, Search Cost (GPU days)=3150, Search Method=evolution2018.0624.37.6
AmoebaNet-CType=Micro search space, Venue=AAAI19, GPUs=450, Times (days)=7, Params (million)=6.4, +x (million)=5702019.1024.37.6
AmoebaNet-CParams (M)=6.4, Mult-Adds (M)=570, Search Cost (GPU-days)=3150, Search Method=evolution2019.0724.37.6
AmoebaNet-CParams (M)=6.4, Multiply-Add operations (M)=570, Search Cost (GPU-days)=3150, Search Method=evolution2019.1124.37.6
AmoebaNet-CParams (M)=6.4, Search Cost (GPU days)=3150, Search Method=evolution, Search Dataset=CIFAR-102020.0624.37.6
AmoebaNet-CParams (M)=6.4, Search Cost (GPU days)=3150, Search Method=evolution, Search Dataset=CIFAR-102021.0224.37.6
AmoebaNet-CParams (M)=6.4, FLOPS(M)=570, Search Cost (GPU days)=3150, Searched Method=evolution, Searched dataset=CIFAR-102021.0824.37.6
GenNAS-D14Params (M)=5.3, FLOPS(M)=599, Search Cost (GPU days)=0.7*+0.04, Searched Method=evolution+few-shot, Searched dataset=CIFAR-102021.0824.37.2
AmoebaNet-CSearch strategy=evolution, Params=6.4M, Search cost=3150 GPU days, Search dataset=CIFAR-102022.1124.37.6
DrNASSearch strategy=gradient, Params=5.7M, Search cost=N/A, Search dataset=ImageNet, reproduced=true2022.1124.37.4
Shapley-NASSearch strategy=gradient, Params=5.1M, Search cost=0.3 GPU days, Search dataset=CIFAR-102022.1124.37.6
SGAS (Cri.2 avg.)Params (M)=5.4, Multiply-Add operations (M)=597, Search Cost (GPU-days)=0.25, Search Method=gradient2019.1124.387.39
P-DARTS (CIFAR10)Params (M)=4.9, Mult-Adds (M)=557, Search Cost (GPU-days)=0.3, Search Method=gradient-based2019.0724.47.4
P-DARTSParams (M)=4.9, Multiply-Add operations (M)=557, Search Cost (GPU-days)=0.3, Search Method=gradient2019.1124.47.4
P-DARTS (CIFAR-10)Params (M)=4.9, Search Cost (GPU days)=0.3, Search Method=gradient, Search Dataset=CIFAR-102020.0624.47.4
P-DARTS (CIFAR-10)Params (M)=4.9, Search Cost (GPU days)=0.3, Search Method=gradient, Search Dataset=CIFAR-102021.0224.47.4
P-DARTSParams (M)=4.9, FLOPS(M)=557, Search Cost (GPU days)=0.3, Searched Method=gradient-based, Searched dataset=CIFAR-102021.0824.47.4
P-DARTSParams (M)=4.9, Search Cost (GPU Days)=0.3, Search Method=Gradient, Evaluation Protocol=One-shot, Year=ICCV2019, Search Space=DARTS2022.0424.47.4
EVNASParams (M)=5.1, GPU=1 2080 Ti, Search Cost (GPU Days)=3.83, Search Method=Evolution, Evaluation Protocol=One-shot, Year=GECCO2021, Search Space=DARTS2022.0424.47.4
P-DARTSSearch strategy=gradient, Params=4.9M, Search cost=0.3 GPU days, Search dataset=CIFAR-102022.1124.47.4
SGAS (Cri.1 avg.)Params (M)=5.3, Multiply-Add operations (M)=579, Search Cost (GPU-days)=0.25, Search Method=gradient2019.1124.417.29
BOHNAS (best)Search strategy=BO, Params=5.4M, Search cost=8 GPU days, Search dataset=CIFAR-102022.1124.487.3
TE-NASParams (M)=5.4, Search Cost (GPU days)=0.17, Search Method=training-free, Search Dataset=ImageNet2021.0224.57.5
TE-NASParams (M)=5.4, FLOPS(M)=599, Search Cost (GPU days)=0.17, Searched Method=training-free, Searched dataset=ImageNet2021.0824.57.5
TE-NASParadigm=training-free, Params (M)=5.4, FLOPS (M)=5912022.0824.57.5
BONAS-CSearch strategy=BO, Params=5.1M, Search cost=7.5 GPU days, Search dataset=CIFAR-102022.1124.67.5
P-DARTSSearch strategy=gradient, Params=4.9M, Search cost=N/A, Search dataset=CIFAR-10, reproduced=true2022.1124.67.5
P-DARTS (CIFAR100)Params (M)=5.1, Mult-Adds (M)=577, Search Cost (GPU-days)=0.3, Search Method=gradient-based2019.0724.77.5
FairNAS-AParams (M)=4.6, Multiply-Add operations (M)=388, Search Cost (GPU-days)=12, Search Method=evolution2019.1124.77.6
P-DARTS (CIFAR-100)Params (M)=5.1, Search Cost (GPU days)=0.3, Search Method=gradient, Search Dataset=CIFAR-1002020.0624.77.5
P-DARTS (CIFAR-100)Params (M)=5.1, Search Cost (GPU days)=0.3, Search Method=gradient, Search Dataset=CIFAR-1002021.0224.77.5
P-DARTSParams (M)=5.1, FLOPS(M)=577, Search Cost (GPU days)=0.3, Searched Method=gradient-based, Searched dataset=CIFAR-1002021.0824.77.5
CARSParams (M)=5.1, Search Cost (GPU Days)=0.4, Search Method=Evolution, Evaluation Protocol=One-shot, Year=CVPR2020, Search Space=DARTS2022.0424.87.5
ProxylessNAS (GPU)Params (M)=7.1, Mult-Adds (M)=465, Search Cost (GPU-days)=8.3, Search Method=gradient-based2019.0724.97.5
ProxylessNASParams (M)=7.1, Multiply-Add operations (M)=465, Search Cost (GPU-days)=8.3, Search Method=gradient2019.1124.97.5
ProxylessNAS (GPU)Params (M)=7.1, Search Cost (GPU days)=8.3, Search Method=gradient, Search Dataset=ImageNet2020.0624.97.5
ProxylessNAS (GPU)Params (M)=7.1, Search Cost (GPU days)=8.3, Search Method=gradient, Search Dataset=ImageNet2021.0224.97.5
ProxylessNASParams (M)=7.1, FLOPS(M)=465, Search Cost (GPU days)=8.3, Searched Method=gradient-based, Searched dataset=ImageNet2021.0824.97.5
Shapley-NASSearch strategy=gradient, Params=5.1M, Search cost=N/A, Search dataset=CIFAR-10, reproduced=true2022.1124.97.6
Shapley-NASSearch strategy=gradient, Params=5.4M, Search cost=N/A, Search dataset=ImageNet, reproduced=true2022.11257.6
ShuffleNet 2x (v2)Params (M)=~5, Mult-Adds (M)=591, Search Method=manual2019.0725.1—
PC-DARTS (CIFAR10)Params (M)=5.3, Mult-Adds (M)=586, Search Cost (GPU-days)=0.1, Search Method=gradient-based2019.0725.17.8
ShuffleNet 2x (v2)Params (M)=~5, Multiply-Add operations (M)=591, Search Cost (GPU-days)=manual, Search Method=manual2019.1125.1—
PC-DARTSParams (M)=5.3, Multiply-Add operations (M)=586, Search Cost (GPU-days)=0.1, Search Method=gradient2019.1125.17.8
ShuffleNet 2x (v2)Params (M)=~5, Search Method=manual2020.0625.1—
PC-DARTS (CIFAR-10)Params (M)=5.3, Search Cost (GPU days)=0.1, Search Method=gradient, Search Dataset=CIFAR-102020.0625.17.8
PC-DARTS (CIFAR-10)Params (M)=5.3, Search Cost (GPU days)=0.1, Search Method=gradient, Search Dataset=CIFAR-102021.0225.17.8
PC-DARTSParams (M)=5.3, FLOPS(M)=586, Search Cost (GPU days)=0.1, Searched Method=gradient-based, Searched dataset=CIFAR-102021.0825.17.8
GenNAS-comboParams (M)=4.8, FLOPS(M)=559, Search Cost (GPU days)=0.04, Searched Method=evolution+few-shot, Searched dataset=CIFAR-102021.0825.17.8
FreeNASParadigm=training-free, Params (M)=3.6, FLOPS (M)=5922022.0825.17.8
ShuffleNet 2x (v2)Type=manual, Params=~5M, Search cost=N/A, Search dataset=CIFAR-102022.1125.1—
PC-DARTSSearch strategy=gradient, Params=3.6M, Search cost=0.1 GPU days, Search dataset=CIFAR-102022.1125.17.8
MnasNet-92Params (M)=4.4, Mult-Adds (M)=388, Search Method=RL2019.0725.28
MnasNet-92Params (M)=4.4, Multiply-Add operations (M)=388, Search Method=RL2019.1125.28
MnasNet-92Params (M)=4.4, Search Method=RL, Search Dataset=CIFAR-102020.0625.28
MnasNet-92Params (M)=4.4, Search Method=RL, Search Dataset=CIFAR-102021.0225.28
EcoNASParams (M)=4.3, GPU=1 1080Ti, Search Cost (GPU Days)=8, Search Method=Evolution, Evaluation Protocol=Conventional, Year=CVPR2020, Search Space=DARTS2022.0425.2—
MnasNet-92Search strategy=RL, Params=4.4M, Search cost=not reported, Search dataset=CIFAR-102022.1125.28
TreeCell-B with CondenseNetG1=4, G3=8, Multiply-add operations (x+)=594M2018.0625.48.1
BONAS-DSearch strategy=BO, Params=4.8M, Search cost=10 GPU days, Search dataset=CIFAR-102022.1125.48
TreeCell-A with CondenseNetG1=4, G3=8, Multiply-add operations (x+)=588M2018.0625.58
AmoebaNet-AParams (M)=5.1, +x (M)=555, Search Cost (GPU days)=3150, Search Method=evolution2018.0625.58
AmoebaNet-AType=Micro search space, Venue=AAAI19, GPUs=450, Times (days)=7, Params (million)=5.1, +x (million)=5552019.1025.58
AmoebaNet-AParams (M)=5.1, Multiply-Add operations (M)=555, Search Cost (GPU-days)=3150, Search Method=evolution2019.1125.58
AmoebaNet-AParams (M)=5.1, GPU=450 K40, Search Cost (GPU Days)=3150, Search Method=Evolution, Evaluation Protocol=Conventional, Year=AAAI20192022.0425.58
SPOSParadigm=single-path, Params (M)=4.6, FLOPS (M)=5122022.0825.57.9
DSNASSearch Method=gradient, Search Dataset=ImageNet2020.0625.78.1
PNASParams (M)=5.1, +x (M)=588, Search Cost (GPU days)=~225, Search Method=SMBO2018.0625.88.1
Progressive NASType=Micro search space, Venue=ECCV18, GPUs=100, Times (days)=1.5, Params (million)=5.1, +x (million)=5882019.1025.88.1
PNASParams (M)=5.1, Mult-Adds (M)=588, Search Cost (GPU-days)=225, Search Method=SMBO2019.0725.88.1
PNASParams (M)=5.1, Multiply-Add operations (M)=588, Search Cost (GPU-days)=225, Search Method=SMBO2019.1125.88.1
PNASParams (M)=5.1, Search Cost (GPU days)=225, Search Method=SMBO, Search Dataset=CIFAR-102020.0625.88.1
PNASParams (M)=5.1, Search Cost (GPU days)=225, Search Method=SMBO, Search Dataset=CIFAR-102021.0225.88.1
PNASParams (M)=5.1, FLOPS(M)=588, Search Cost (GPU days)=225, Searched Method=SMBO, Searched dataset=CIFAR-102021.0825.88.1
PNASParams (M)=5.1, Search Cost (GPU Days)=225, Search Method=SMBO, Evaluation Protocol=Predictor, Year=ECCV20182022.0425.88.1
PNASSearch strategy=BO, Params=5.1M, Search cost=255 GPU days, Search dataset=CIFAR-102022.1125.88.1
NASNet-AN=4, Multiply-add operations (x+)=564M2018.06268.4
NASNet-AParams (M)=5.3, +x (M)=564, Search Cost (GPU days)=2000, Search Method=RL2018.06268.4
AmoebaNet-BParams (M)=5.3, +x (M)=555, Search Cost (GPU days)=3150, Search Method=evolution2018.06268.5
NASNet-AType=Micro search space, Venue=CVPR18, GPUs=450, Times (days)=3-4, Params (million)=5.3, +x (million)=5642019.10268.4
AmoebaNet-BType=Micro search space, Venue=AAAI19, GPUs=450, Times (days)=7, Params (million)=5.3, +x (million)=5552019.10268.5
GDAS [C=50,N=4]Type=Micro search space, Venue=CVPR19, GPUs=1, Times (days)=0.21, Params (million)=5.3, +x (million)=5812019.10268.5