Image Classification on ImageNet-16-120 NAS-Bench-201 (test)
53.2AccuracyLLMasTool
Evaluation Results
| Method | Links | |
|---|---|---|
| LLMasToolSearch space=open-ended NAS, LLM-based=true, Search (archs)=5002026.04 | 53.2 | |
| FairNADSearch (archs)=500, Search space=open-ended NAS, LLM-based=true2026.05 | 52.87 | |
| NADERSearch space=open-ended NAS, LLM-based=true, Search (archs)=5002026.04 | 50.52 | |
| LLMasToolSearch space=open-ended NAS, LLM-based=true, Search (archs)=1002026.04 | 50.43 | |
| optimal2020.06 | 47.31 | |
| Optimal2021.02 | 47.31 | |
| optimum2022.04 | 47.31 | |
| optimalSearch Dataset Protocol=Direct search on evaluation dataset2022.06 | 47.31 | |
| optimalSearch Space=NAS-Bench-2012022.08 | 47.31 | |
| optimalSearch Space=NAS-Bench-2012022.11 | 47.31 | |
| Optimal2024.02 | 47.31 | |
| OptimalApplicable Space=-2024.02 | 47.31 | |
| NAS-Bench-201 OptimalSearch (archs)=-2026.04 | 47.31 | |
| CoLLM-NASSearch space=hand crafted, LLM-based=true, Search (archs)=1002026.04 | 46.79 | |
| DARTS- (best)Cost (hours)=3.2, Evaluation=Best searched model2020.09 | 46.34 | |
| DrNAS2020.06 | 46.34 | |
| MIM-DARTSSearch Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.11 | 46.34 | |
| ParZCsearch seconds=68.952024.02 | 46.34 | |
| ParZCCost (GPU Sec.)=68, Method=hybrid, Applicable Space=C & D2024.02 | 46.34 | |
| β-DARTS2026.02 | 46.34 | |
| MIDASSearch Dataset=CIFAR-10, Selection=Best Found2026.02 | 46.34 | |
| DRNASSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.04 | 46.34 | |
| β-DARTSSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.04 | 46.34 | |
| Λ-DARTSSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.04 | 46.34 | |
| TNAS (best)Search Cost (hours)=3.6, Search Method=tree2022.04 | 46.33 | |
| arch2vec-BOSearch Space=NAS-Bench-201, Search Strategy=BO2020.06 | 46.27 | |
| arch2vec-RLSearch Space=NAS-Bench-201, Search Strategy=REINFORCE2020.06 | 46.16 | |
| RF-DARTSSearch Space=NAS-Bench-2012022.08 | 46.1 | |
| AGNAS2026.02 | 45.98 | |
| ReNASsearch seconds=86.312024.02 | 45.97 | |
| beta-DARTSSearch Dataset=CIFAR-10, Search Space=NAS-Bench-201, Reproduced=true2022.11 | 45.92 | |
| NASBOT2024.02 | 45.88 | |
| LLMaticSearch space=open-ended NAS, LLM-based=true, Search (archs)=20002026.04 | 45.87 | |
| OptimalSearch (s)=N/A, Sample size N=1002020.06 | 45.67 | |
| RESearch Space=NAS-Bench-2012020.06 | 45.63 | |
| REASearch (s)=120002020.06 | 45.54 | |
| REASearch Time (s)=12000, Search Approach=Non-weight sharing2021.02 | 45.54 | |
| REAsearch seconds=0.022024.02 | 45.54 | |
| REASearch space=hand crafted, Parameter sharing=false, LLM-based=false, Search (archs)=5002026.04 | 45.54 | |
| CyDASSearch Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.11 | 45.51 | |
| RSSearch Space=NAS-Bench-2012020.06 | 45.33 | |
| REINFORCESearch Space=NAS-Bench-2012020.06 | 45.3 | |
| BOHBSearch Space=NAS-Bench-2012020.06 | 45.26 | |
| REINFORCESearch (s)=120002020.06 | 45.24 | |
| REINFORCEsearch seconds=0.122024.02 | 45.24 | |
| REINFORCECost (GPU Sec.)=12000, Method=RL, Applicable Space=C & D2024.02 | 45.24 | |
| REINFORCESearch space=hand crafted, Parameter sharing=false, LLM-based=false, Search (archs)=5002026.04 | 45.24 | |
| AutoMCUSearch (Archs)=10, LLM=DeepSeek-V3.2, Temperature=02026.05 | 45.19 | |
| REACost (GPU Sec.)=12000, Method=evolution, Applicable Space=C & D2024.02 | 45.15 | |
| DARTS-Cost (hours)=3.2, Evaluation=Average of 4 runs2020.09 | 45.12 | |
| DARTS-Search Space=NAS-Bench-2012022.08 | 45.12 | |
| DARTS-Search Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.11 | 45.12 | |
| DARTS-2026.02 | 45.12 | |
| MIDASSearch Dataset=CIFAR-102026.02 | 45.12 | |
| GENIUSSearch space=hand crafted, LLM-based=true, Search (archs)=102026.04 | 44.96 | |
| NASI (4T)Search Method=training-free, Search Cost (GPU Sec.)=1202021.09 | 44.84 | |
| NASICost (GPU Sec.)=120, Method=training-free, Applicable Space=C2024.02 | 44.84 | |
| RSSearch (s)=120002020.06 | 44.57 | |
| Random Samplesearch seconds=0.012024.02 | 44.57 | |
| RS (w/o sharing)Cost (GPU Sec.)=12000, Method=random, Applicable Space=C & D2024.02 | 44.57 | |
| RSSearch space=hand crafted, Parameter sharing=false, LLM-based=false, Search (archs)=5002026.04 | 44.57 | |
| GENIUSSearch (Archs)=10, LLM=DeepSeek-V3.2, Temperature=02026.05 | 44.51 | |
| NASWOTSearch (s)=306.19, Sample size N=10002020.06 | 44.44 | |
| NASWOT (N=1000)Search Method=training-free, Search Cost (GPU Sec.)=3062021.09 | 44.44 | |
| NWOTCost (GPU Sec.)=306, Method=training-free, Applicable Space=C & D2024.02 | 44.44 | |
| BOHBSearch (s)=120002020.06 | 44.42 | |
| BOHBsearch seconds=3.592024.02 | 44.42 | |
| BOHBCost (GPU Sec.)=12000, Method=BO+bandit, Applicable Space=C & D2024.02 | 44.42 | |
| BOHBSearch space=hand crafted, Parameter sharing=false, LLM-based=false, Search (archs)=5002026.04 | 44.42 | |
| DrNASCost (GPU Sec.)=14887, Method=gradient, Applicable Space=C2024.02 | 44.02 | |
| ResNet2020.06 | 43.63 | |
| ResNet2021.02 | 43.63 | |
| ResNet2022.04 | 43.63 | |
| ResNetSearch Method=N/A, Search Cost (GPU Sec.)=N/A2021.09 | 43.63 | |
| ResNetSearch Dataset Protocol=Direct search on evaluation dataset2022.06 | 43.63 | |
| ResNet2024.02 | 43.63 | |
| ResNetCost (GPU Sec.)=manual, Method=manual, Applicable Space=-2024.02 | 43.63 | |
| ResNetSearch (archs)=-2026.04 | 43.63 | |
| EZNASMethod=hybrid, Applicable Space=D2024.02 | 43.47 | |
| OptimalSearch (s)=N/A, Sample size N=102020.06 | 43.3 | |
| MIDASSearch Dataset=CIFAR-1002026.02 | 43.29 | |
| Reinforce2020.06 | 43.16 | |
| SNAS2020.06 | 43.16 | |
| SNAS2020.05 | 43.16 | |
| SNASSearch Dataset=CIFAR-10, Search Space=NAS-Bench-2012022.11 | 43.16 | |
| SNASSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.04 | 43.16 | |
| NASWOTSearch (s)=30.01, Sample size N=1002020.06 | 43.1 | |
| NASWOT (N=100)Search Method=training-free, Search Cost (GPU Sec.)=302021.09 | 43.1 | |
| Randomtype=baseline2020.06 | 42.96 | |
| GradSignMethod=training-free, Applicable Space=C & D2024.02 | 42.42 | |
| TE-NASSearch Cost (GPU sec.)=1558, Search Method=training-free2021.02 | 42.38 | |
| TE-NASSearch Method=training-free, Search Cost (GPU Sec.)=15582021.09 | 42.38 | |
| TE-NASCost (GPU Sec.)=1558, Method=training-free, Applicable Space=C2024.02 | 42.38 | |
| NoisyDARTSCost (hrs)=3.22020.05 | 42.34 | |
| GDASCost (GPU Sec.)=8640, Method=gradient, Applicable Space=C2024.02 | 42.23 | |
| EPE-NASSearch Time (s)=2.3, Search Approach=Training-free, Sample Size (N)=102021.02 | 41.92 | |
| GDASSearch Cost (GPU sec.)=28925.91, Search Method=gradient2021.02 | 41.84 | |
| GDASSearch (s)=289262020.06 | 41.84 | |
| GDASSearch Method=gradient, Search Cost (GPU Sec.)=289262021.09 | 41.84 | |
| GDASsearch seconds=28925.912024.02 | 41.84 |