List your company
ResearchFormerly WizWand

Image Classification on ImageNet 16-120 NAS-Bench-201 (val)

52.73AccuracyFairNAD
30.713236.429142.14547.8609May 7, 2020May 9, 2021May 11, 2022May 14, 2023May 15, 2024May 17, 2025May 20, 2026
Updated 5mo ago

Evaluation results

MethodLinks
FairNADSearch (archs)=500, Search space=open-ended NAS, LLM-based=true2026.0552.73
LLMasToolSearch space=open-ended NAS, LLM-based=true, Search (archs)=5002026.0452.3
LLMasToolSearch space=open-ended NAS, LLM-based=true, Search (archs)=1002026.0450.4
NADERSearch space=open-ended NAS, LLM-based=true, Search (archs)=5002026.0450.2
optimal2020.0646.77
optimalSearch Dataset Protocol=Direct search on evaluation dataset2022.0646.77
optimalSearch Space=NAS-Bench-2012022.0846.77
optimalSearch Space=NAS-Bench-2012022.1146.77
NAS-Bench-201 OptimalSearch (archs)=-2026.0446.77
Optimal2024.0246.73
CoLLM-NASSearch space=hand crafted, LLM-based=true, Search (archs)=1002026.0446.62
RF-DARTSSearch Space=NAS-Bench-2012022.0846.4
DARTS- (best)Cost (hours)=3.2, Evaluation=Best searched model2020.0946.37
DrNAS2020.0646.37
ParZCsearch seconds=68.952024.0246.37
β-DARTS2026.0246.37
MIDASSearch Dataset=CIFAR-10, Selection=Best Found2026.0246.37
DRNASSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.0446.37
β-DARTSSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.0446.37
Λ-DARTSSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.0446.37
arch2vec-BOSearch Space=NAS-Bench-201, Search Strategy=BO2020.0646.34
arch2vec-RLSearch Space=NAS-Bench-201, Search Strategy=REINFORCE2020.0646.22
beta-DARTSSearch Dataset=CIFAR-10, Search Space=NAS-Bench-201, Reproduced=true2022.1146.22
MIM-DARTSSearch Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.1146.17
ReNASsearch seconds=86.312024.0245.85
RESearch Space=NAS-Bench-2012020.0645.78
AREASearch (s)=120002020.0645.7
REINFORCESearch Space=NAS-Bench-2012020.0645.58
AGNAS2026.0245.5
RSSearch Space=NAS-Bench-2012020.0645.47
BOHBSearch Space=NAS-Bench-2012020.0645.44
OptimalSearch (s)=N/A, Sample size N=1002020.0645.37
GENIUSSearch space=hand crafted, LLM-based=true, Search (archs)=102026.0445.29
REASearch (s)=120002020.0645.15
REAsearch seconds=0.022024.0245.15
REASearch space=hand crafted, Parameter sharing=false, LLM-based=false, Search (archs)=5002026.0445.15
CyDASSearch Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.1145.09
AutoMCUSearch (Archs)=10, LLM=DeepSeek-V3.2, Temperature=02026.0545.07
REINFORCESearch (s)=120002020.0645.05
REINFORCEsearch seconds=0.122024.0245.05
REINFORCESearch space=hand crafted, Parameter sharing=false, LLM-based=false, Search (archs)=5002026.0445.05
MIDASSearch Dataset=CIFAR-102026.0244.97
DARTS-Cost (hours)=3.2, Evaluation=Average of 4 runs2020.0944.87
DARTS-Search Space=NAS-Bench-2012022.0844.87
DARTS-Search Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.1144.87
DARTS-2026.0244.87
GENIUSSearch (Archs)=10, LLM=DeepSeek-V3.2, Temperature=02026.0544.63
ResNet2020.0644.53
ResNetSearch Dataset Protocol=Direct search on evaluation dataset2022.0644.53
ResNet2024.0244.53
ResNetSearch (archs)=-2026.0444.53
RSSearch (s)=120002020.0644.45
Random Samplesearch seconds=0.012024.0244.45
RSSearch space=hand crafted, Parameter sharing=false, LLM-based=false, Search (archs)=5002026.0444.45
BOHBSearch (s)=120002020.0644.26
BOHBsearch seconds=3.592024.0244.26
BOHBSearch space=hand crafted, Parameter sharing=false, LLM-based=false, Search (archs)=5002026.0444.26
MIDASSearch Dataset=CIFAR-1002026.0244.08
NASWOTSearch (s)=306.19, Sample size N=10002020.0643.95
OptimalSearch (s)=N/A, Sample size N=102020.0643.11
Reinforce2020.0643.04
Randomtype=baseline2020.0642.92
SNAS2020.0642.84
SNAS2020.0542.84
SNASSearch Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.1142.84
SNASSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.0442.84
NASWOTSearch (s)=30.01, Sample size N=1002020.0642.81
NoisyDARTSCost (hrs)=3.22020.0542.47
GDASSearch (s)=289262020.0641.7
GDASsearch seconds=28925.912024.0241.7
GDASCost (hours)=8.72020.0941.59
GDASCost (hrs)=8.72020.0541.59
GDASSearch Space=NAS-Bench-2012022.0841.59
GDASSearch Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.1141.59
GDAS2026.0241.59
GDASSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.0441.59
NASWOTSearch (s)=3.05, Sample size N=102020.0641.09
PC-DARTS2020.0640.83
PCDARTS2020.0540.83
PC-DARTSSearch Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.1140.83
PC-DARTS2026.0240.83
PC-DARTSSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.0440.83
GDAS2020.0640.66
DSNAS2020.0640.61
DSNAS2020.0540.61
DSNASSearch Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.1140.61
DSNASSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.0440.61
iDARTSSearch Space=NAS-Bench-2012022.0840.38
iDARTSSearch Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.1140.38
iDARTS2026.0240.38
iDARTSSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.0440.38
RandomSearch (s)=N/A2020.0633.34
SETNCost (hours)=9.52020.0933.06
SETNCost (hrs)=9.52020.0533.06
SETNSearch Space=NAS-Bench-2012022.0833.06
SETNSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.0433.06
SETNSearch (s)=310102020.0632.54
SETNsearch seconds=31009.812024.0232.54
RSPSSearch (s)=75872020.0631.56
RSPSsearch seconds=7587.122024.0231.56