List your company
ResearchFormerly WizWand

Image Classification on CIFAR-100 NAS-Bench-201 (val)

78.75AccuracyFairNAD
58.2163.542568.87574.2075May 7, 2020May 9, 2021May 11, 2022May 14, 2023May 15, 2024May 17, 2025May 20, 2026
Updated 5mo ago

Evaluation results

MethodLinks
FairNADSearch (archs)=500, Search space=open-ended NAS, LLM-based=true2026.0578.75
LLMasToolSearch space=open-ended NAS, LLM-based=true, Search (archs)=5002026.0477.51
LLMasToolSearch space=open-ended NAS, LLM-based=true, Search (archs)=1002026.0476.48
NADERSearch space=open-ended NAS, LLM-based=true, Search (archs)=5002026.0475.72
DARTS- (best)Cost (hours)=3.2, Evaluation=Best searched model2020.0973.49
DrNAS2020.0673.49
optimal2020.0673.49
optimalSearch Dataset Protocol=Direct search on evaluation dataset2022.0673.49
optimalSearch Space=NAS-Bench-2012022.0873.49
optimalSearch Space=NAS-Bench-2012022.1173.49
optimal2022.1173.49
ParZCsearch seconds=68.952024.0273.49
Optimal2024.0273.49
β-DARTS2026.0273.49
MIDASSearch Dataset=CIFAR-10, Selection=Best Found2026.0273.49
NAS-Bench-201 OptimalSearch (archs)=-2026.0473.49
DRNASSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.0473.49
β-DARTSSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.0473.49
Λ-DARTSSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.0473.49
NAS-Bench-201 OptimalSearch (archs)=-, Search space=hand-crafted search space2026.0573.49
CoLLM-NASSearch space=hand crafted, LLM-based=true, Search (archs)=1002026.0473.44
arch2vec-BOSearch Space=NAS-Bench-201, Search Strategy=BO2020.0673.35
MIM-DARTSSearch Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.1173.21
arch2vec-RLSearch Space=NAS-Bench-201, Search Strategy=REINFORCE2020.0673.13
RESearch Space=NAS-Bench-2012020.0673.02
beta-DARTSSearch Dataset=CIFAR-10, Search Space=NAS-Bench-201, Reproduced=true2022.1173.02
RF-DARTSSearch Space=NAS-Bench-2012022.0872.95
MIDASSearch Dataset=CIFAR-102026.0272.8
BOHBSearch Space=NAS-Bench-2012020.0672.59
AGNAS2026.0272.4
REINFORCESearch Space=NAS-Bench-2012020.0672.35
AutoMCUSearch (Archs)=10, LLM=DeepSeek-V3.2, Temperature=02026.0572.32
RSSearch Space=NAS-Bench-2012020.0672.17
CyDASSearch Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.1172.12
ReNASsearch seconds=86.312024.0271.96
AREASearch (s)=120002020.0671.95
REASearch (s)=120002020.0671.81
REAsearch seconds=0.022024.0271.81
REASearch space=hand crafted, Parameter sharing=false, LLM-based=false, Search (archs)=5002026.0471.81
REINFORCESearch (s)=120002020.0671.61
REINFORCEsearch seconds=0.122024.0271.61
REINFORCESearch space=hand crafted, Parameter sharing=false, LLM-based=false, Search (archs)=5002026.0471.61
OptimalSearch (s)=N/A, Sample size N=1002020.0671.45
GENIUSSearch (Archs)=10, LLM=DeepSeek-V3.2, Temperature=02026.0571.37
DARTS-Cost (hours)=3.2, Evaluation=Average of 4 runs2020.0971.36
NoisyDARTSCost (hrs)=3.22020.0571.36
DARTS-Search Space=NAS-Bench-2012022.0871.36
DARTS-Search Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.1171.36
DARTS-2026.0271.36
GDASCost (hours)=8.72020.0971.34
GDASCost (hrs)=8.72020.0571.34
GDASSearch Space=NAS-Bench-2012022.0871.34
GDASSearch Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.1171.34
GDAS2026.0271.34
GDASSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.0471.34
GDASSearch (archs)=-, Search space=hand-crafted search space, Parameter sharing=true2026.0571.34
GDASsearch seconds=28925.912024.0271.15
GDASSearch (s)=289262020.0671.14
GDASType=One-shot2022.1171.14
GENIUSSearch space=hand crafted, LLM-based=true, Search (archs)=102026.0470.96
RSSearch (s)=120002020.0670.93
Random Samplesearch seconds=0.012024.0270.93
RSSearch space=hand crafted, Parameter sharing=false, LLM-based=false, Search (archs)=5002026.0470.93
BOHBSearch (s)=120002020.0670.74
BOHBsearch seconds=3.592024.0270.74
BOHBSearch space=hand crafted, Parameter sharing=false, LLM-based=false, Search (archs)=5002026.0470.74
Randomtype=baseline2020.0670.6
iDARTSSearch Space=NAS-Bench-2012022.0870.57
iDARTSSearch Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.1170.57
iDARTS2026.0270.57
iDARTSSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.0470.57
ResNet2020.0670.42
ResNetSearch Dataset Protocol=Direct search on evaluation dataset2022.0670.42
ResNetType=Manual2022.1170.42
ResNet2024.0270.42
ResNetSearch (archs)=-2026.0470.42
ResNetSearch (archs)=-, Search space=hand-crafted search space2026.0570.42
MIDASSearch Dataset=CIFAR-1002026.0270.34
Reinforce2020.0670.05
NASNetType=Vanilla2022.1170.05
NASWOTSearch (s)=306.19, Sample size N=10002020.0669.86
SNAS2020.0669.69
SNAS2020.0569.69
SNASSearch Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.1169.69
SNASSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.0469.69
OptimalSearch (s)=N/A, Sample size N=102020.0669.61
NAS-LID+RSPSType=Few-shot2022.1169.38
NASWOTSearch (s)=30.01, Sample size N=1002020.0669.35
NASWOTSearch (s)=3.05, Sample size N=102020.0668.5
GM-NAS+RSPSType=Few-shot2022.1168.36
PC-DARTS2020.0667.12
PCDARTS2020.0567.12
PC-DARTSSearch Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.1167.12
PC-DARTSType=One-shot2022.1167.12
PC-DARTS2026.0267.12
PC-DARTSSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.0467.12
LeMo-NADe(GPT4)Search space=open-ended NAS, LLM-based=true, Search (archs)=302026.0463.38
RandomSearch (s)=N/A2020.0660.7
RSPSSearch (s)=75872020.0659
RSPSType=One-shot2022.1159