List your company
ResearchFormerly WizWand

Image Classification on ImageNet-16-120 NAS-Bench-201 (test)

53.2AccuracyLLMasTool
41.385644.452847.5250.5872May 7, 2020May 9, 2021May 11, 2022May 14, 2023May 15, 2024May 17, 2025May 20, 2026
Updated 5mo ago

Evaluation results

MethodLinks
LLMasToolSearch space=open-ended NAS, LLM-based=true, Search (archs)=5002026.0453.2
FairNADSearch (archs)=500, Search space=open-ended NAS, LLM-based=true2026.0552.87
NADERSearch space=open-ended NAS, LLM-based=true, Search (archs)=5002026.0450.52
LLMasToolSearch space=open-ended NAS, LLM-based=true, Search (archs)=1002026.0450.43
optimal2020.0647.31
Optimal2021.0247.31
optimum2022.0447.31
optimalSearch Dataset Protocol=Direct search on evaluation dataset2022.0647.31
optimalSearch Space=NAS-Bench-2012022.0847.31
optimalSearch Space=NAS-Bench-2012022.1147.31
Optimal2024.0247.31
OptimalApplicable Space=-2024.0247.31
NAS-Bench-201 OptimalSearch (archs)=-2026.0447.31
CoLLM-NASSearch space=hand crafted, LLM-based=true, Search (archs)=1002026.0446.79
DARTS- (best)Cost (hours)=3.2, Evaluation=Best searched model2020.0946.34
DrNAS2020.0646.34
MIM-DARTSSearch Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.1146.34
ParZCsearch seconds=68.952024.0246.34
ParZCCost (GPU Sec.)=68, Method=hybrid, Applicable Space=C & D2024.0246.34
β-DARTS2026.0246.34
MIDASSearch Dataset=CIFAR-10, Selection=Best Found2026.0246.34
DRNASSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.0446.34
β-DARTSSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.0446.34
Λ-DARTSSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.0446.34
TNAS (best)Search Cost (hours)=3.6, Search Method=tree2022.0446.33
arch2vec-BOSearch Space=NAS-Bench-201, Search Strategy=BO2020.0646.27
arch2vec-RLSearch Space=NAS-Bench-201, Search Strategy=REINFORCE2020.0646.16
RF-DARTSSearch Space=NAS-Bench-2012022.0846.1
AGNAS2026.0245.98
ReNASsearch seconds=86.312024.0245.97
beta-DARTSSearch Dataset=CIFAR-10, Search Space=NAS-Bench-201, Reproduced=true2022.1145.92
NASBOT2024.0245.88
LLMaticSearch space=open-ended NAS, LLM-based=true, Search (archs)=20002026.0445.87
OptimalSearch (s)=N/A, Sample size N=1002020.0645.67
RESearch Space=NAS-Bench-2012020.0645.63
REASearch (s)=120002020.0645.54
REASearch Time (s)=12000, Search Approach=Non-weight sharing2021.0245.54
REAsearch seconds=0.022024.0245.54
REASearch space=hand crafted, Parameter sharing=false, LLM-based=false, Search (archs)=5002026.0445.54
CyDASSearch Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.1145.51
RSSearch Space=NAS-Bench-2012020.0645.33
REINFORCESearch Space=NAS-Bench-2012020.0645.3
BOHBSearch Space=NAS-Bench-2012020.0645.26
REINFORCESearch (s)=120002020.0645.24
REINFORCEsearch seconds=0.122024.0245.24
REINFORCECost (GPU Sec.)=12000, Method=RL, Applicable Space=C & D2024.0245.24
REINFORCESearch space=hand crafted, Parameter sharing=false, LLM-based=false, Search (archs)=5002026.0445.24
AutoMCUSearch (Archs)=10, LLM=DeepSeek-V3.2, Temperature=02026.0545.19
REACost (GPU Sec.)=12000, Method=evolution, Applicable Space=C & D2024.0245.15
DARTS-Cost (hours)=3.2, Evaluation=Average of 4 runs2020.0945.12
DARTS-Search Space=NAS-Bench-2012022.0845.12
DARTS-Search Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.1145.12
DARTS-2026.0245.12
MIDASSearch Dataset=CIFAR-102026.0245.12
GENIUSSearch space=hand crafted, LLM-based=true, Search (archs)=102026.0444.96
NASI (4T)Search Method=training-free, Search Cost (GPU Sec.)=1202021.0944.84
NASICost (GPU Sec.)=120, Method=training-free, Applicable Space=C2024.0244.84
RSSearch (s)=120002020.0644.57
Random Samplesearch seconds=0.012024.0244.57
RS (w/o sharing)Cost (GPU Sec.)=12000, Method=random, Applicable Space=C & D2024.0244.57
RSSearch space=hand crafted, Parameter sharing=false, LLM-based=false, Search (archs)=5002026.0444.57
GENIUSSearch (Archs)=10, LLM=DeepSeek-V3.2, Temperature=02026.0544.51
NASWOTSearch (s)=306.19, Sample size N=10002020.0644.44
NASWOT (N=1000)Search Method=training-free, Search Cost (GPU Sec.)=3062021.0944.44
NWOTCost (GPU Sec.)=306, Method=training-free, Applicable Space=C & D2024.0244.44
BOHBSearch (s)=120002020.0644.42
BOHBsearch seconds=3.592024.0244.42
BOHBCost (GPU Sec.)=12000, Method=BO+bandit, Applicable Space=C & D2024.0244.42
BOHBSearch space=hand crafted, Parameter sharing=false, LLM-based=false, Search (archs)=5002026.0444.42
DrNASCost (GPU Sec.)=14887, Method=gradient, Applicable Space=C2024.0244.02
ResNet2020.0643.63
ResNet2021.0243.63
ResNet2022.0443.63
ResNetSearch Method=N/A, Search Cost (GPU Sec.)=N/A2021.0943.63
ResNetSearch Dataset Protocol=Direct search on evaluation dataset2022.0643.63
ResNet2024.0243.63
ResNetCost (GPU Sec.)=manual, Method=manual, Applicable Space=-2024.0243.63
ResNetSearch (archs)=-2026.0443.63
EZNASMethod=hybrid, Applicable Space=D2024.0243.47
OptimalSearch (s)=N/A, Sample size N=102020.0643.3
MIDASSearch Dataset=CIFAR-1002026.0243.29
Reinforce2020.0643.16
SNAS2020.0643.16
SNAS2020.0543.16
SNASSearch Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.1143.16
SNASSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.0443.16
NASWOTSearch (s)=30.01, Sample size N=1002020.0643.1
NASWOT (N=100)Search Method=training-free, Search Cost (GPU Sec.)=302021.0943.1
Randomtype=baseline2020.0642.96
GradSignMethod=training-free, Applicable Space=C & D2024.0242.42
TE-NASSearch Cost (GPU sec.)=1558, Search Method=training-free2021.0242.38
TE-NASSearch Method=training-free, Search Cost (GPU Sec.)=15582021.0942.38
TE-NASCost (GPU Sec.)=1558, Method=training-free, Applicable Space=C2024.0242.38
NoisyDARTSCost (hrs)=3.22020.0542.34
GDASCost (GPU Sec.)=8640, Method=gradient, Applicable Space=C2024.0242.23
EPE-NASSearch Time (s)=2.3, Search Approach=Training-free, Sample Size (N)=102021.0241.92
GDASSearch Cost (GPU sec.)=28925.91, Search Method=gradient2021.0241.84
GDASSearch (s)=289262020.0641.84
GDASSearch Method=gradient, Search Cost (GPU Sec.)=289262021.0941.84
GDASsearch seconds=28925.912024.0241.84