List your company
ResearchFormerly WizWand

Image Classification on CIFAR-10 DARTS search space (test)

2.43Best Test ErrorBONAS-D
2.37562.74283.113.4772Nov 3, 2022
Updated 8mo ago

Evaluation results

MethodLinks
BONAS-DType=BO, Params=3.3M, Search cost=10 GPU days2022.112.43————
Shapley-NASType=gradient, Params=3.4/3.6M, Search cost=0.3 GPU day2022.112.43————
BONAS-CType=BO, Params=3.48M, Search cost=7.5 GPU days2022.112.46————
NASBOWLType=BO, Params=3.7M, Search cost=3 GPU days2022.112.5————
DrNAS (reproduced)Type=gradient, Params=4.1M, Search cost=N/A2022.112.51————
BOHNASType=BO, Params=3.9M, Search cost=8 GPU days2022.112.55————
BANANASType=BO, Params=not reported, Search cost=12 GPU days2022.112.57———2.64
Random-WSType=RS, Params=4.3M, Search cost=10 GPU days2022.112.71————
NASBOWL (reproduced)Type=BO, Params=3.7M, Search cost=N/A2022.112.83————
ASHAType=RS with early stopping, Params=4.6M, Search cost=9 GPU days2022.112.85————
ENAS (expanded search space)Type=RL, Params=4.6M, Search cost=6 GPU days2022.112.89————
GDASType=gradient, Params=3.4M, Search cost=0.3 GPU day2022.112.93————
Shapley-NAS (reproduced)Type=gradient, Params=3.6M, Search cost=N/A2022.112.97————
GP-NASType=BO, Params=3.9M, Search cost=1 GPU day2022.113.79————
GDASParams=3.418M, Cost=9.272021.04—0.17690.4893.43—
GDAS + Landmark RegularizationParams=2.540M, Cost=13.242021.04—0.20994.3294.6—
NAOParams=5.080M, Cost=19.722021.04—0.10292.9393.03—
NAO + Landmark RegularizationParams=2.184M, Cost=28.182021.04—0.23193.5393.78—
SPOSParams=5.082M, Cost=12.532021.04—0.05592.892.88—
SPOS + Landmark RegularizationParams=2.181M, Cost=15.962021.04—0.20693.4193.84—
State-of-the-art modelParams=3.62M2021.04———94.02—