Image Classification on CIFAR-10 NAS-Bench-201 (val)
93.06AccuracyLLMasTool
Evaluation results
| Method | Links | |
|---|---|---|
| LLMasToolSearch space=open-ended NAS, LLM-based=true, Search (archs)=5002026.04 | 93.06 | |
| LLMasToolSearch space=open-ended NAS, LLM-based=true, Search (archs)=1002026.04 | 92.51 | |
| FairNADSearch (archs)=500, Search space=open-ended NAS, LLM-based=true2026.05 | 92.2 | |
| FairNADSearch (archs)=100, Search space=open-ended NAS, LLM-based=true2026.05 | 91.77 | |
| optimal2020.06 | 91.61 | |
| optimalSearch Dataset Protocol=Direct search on evaluation dataset2022.06 | 91.61 | |
| optimalSearch Space=NAS-Bench-2012022.08 | 91.61 | |
| optimal2022.11 | 91.61 | |
| optimal2022.11 | 91.61 | |
| Optimal2024.02 | 91.61 | |
| NAS-Bench-201 OptimalSearch (archs)=-2026.04 | 91.61 | |
| NAS-Bench-201 OptimalSearch (archs)=-, Search space=hand-crafted search space, LLM-based=false2026.05 | 91.61 | |
| CoLLM-NASSearch space=hand crafted, LLM-based=true, Search (archs)=1002026.04 | 91.59 | |
| CoLLM-NASSearch (archs)=100, Search space=hand-crafted search space, LLM-based=true2026.05 | 91.59 | |
| DARTS- (best)Cost (hours)=3.2, Evaluation=Best searched model2020.09 | 91.55 | |
| DrNAS2020.06 | 91.55 | |
| ParZCsearch seconds=68.952024.02 | 91.55 | |
| β-DARTS2026.02 | 91.55 | |
| MIDASSearch Dataset=CIFAR-10, Selection=Best Found2026.02 | 91.55 | |
| DRNASSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.04 | 91.55 | |
| β-DARTSSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.04 | 91.55 | |
| Λ-DARTSSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.04 | 91.55 | |
| NADERSearch space=open-ended NAS, LLM-based=true, Search (archs)=5002026.04 | 91.55 | |
| DRNASSearch (archs)=-, Search space=hand-crafted search space, Parameter sharing=true, LLM-based=false2026.05 | 91.55 | |
| β-DARTSSearch (archs)=-, Search space=hand-crafted search space, Parameter sharing=true, LLM-based=false2026.05 | 91.55 | |
| Λ-DARTSSearch (archs)=-, Search space=hand-crafted search space, Parameter sharing=true, LLM-based=false2026.05 | 91.55 | |
| NADERSearch (archs)=500, Search space=open-ended NAS, LLM-based=true2026.05 | 91.55 | |
| arch2vec-BOSearch Space=NAS-Bench-201, Search Strategy=BO2020.06 | 91.41 | |
| arch2vec-RLSearch Space=NAS-Bench-201, Search Strategy=REINFORCE2020.06 | 91.32 | |
| RF-DARTSSearch Space=NAS-Bench-2012022.08 | 91.3 | |
| AGNAS2026.02 | 91.25 | |
| MIDASSearch Dataset=CIFAR-102026.02 | 91.21 | |
| AREASearch (s)=12000, Search Strategy=Training-free2020.06 | 91.2 | |
| REASearch (s)=12000, Search Strategy=Non-weight sharing2020.06 | 91.19 | |
| REASearch Time (s)=12000, Search Approach=Non-weight sharing2021.02 | 91.19 | |
| REAsearch seconds=0.022024.02 | 91.19 | |
| REASearch space=hand crafted, Parameter sharing=false, LLM-based=false, Search (archs)=5002026.04 | 91.19 | |
| REASearch (archs)=500, Search space=hand-crafted search space, Parameter sharing=false, LLM-based=false2026.05 | 91.19 | |
| Reinforce2020.06 | 91.09 | |
| REINFORCESearch (s)=12000, Search Strategy=Non-weight sharing2020.06 | 91.09 | |
| REINFORCESearch Time (s)=12000, Search Approach=Non-weight sharing2021.02 | 91.09 | |
| NASNetType=Vanilla2022.11 | 91.09 | |
| REINFORCEsearch seconds=0.122024.02 | 91.09 | |
| REINFORCESearch space=hand crafted, Parameter sharing=false, LLM-based=false, Search (archs)=5002026.04 | 91.09 | |
| REINFORCESearch (archs)=500, Search space=hand-crafted search space, Parameter sharing=false, LLM-based=false2026.05 | 91.09 | |
| RESearch Space=NAS-Bench-2012020.06 | 91.08 | |
| NPENAS2024.02 | 91.08 | |
| GENIUSSearch space=hand crafted, LLM-based=true, Search (archs)=102026.04 | 91.07 | |
| GENIUSSearch (archs)=10, Search space=hand-crafted search space, LLM-based=true2026.05 | 91.07 | |
| OptimalSearch (s)=N/A, Sample size N=100, Search Strategy=Training-free2020.06 | 91.05 | |
| REINFORCESearch Space=NAS-Bench-2012020.06 | 91.03 | |
| DARTS-Cost (hours)=3.2, Evaluation=Average of 4 runs2020.09 | 91.03 | |
| DARTS-Search Space=NAS-Bench-2012022.08 | 91.03 | |
| DARTS-2026.02 | 91.03 | |
| RSSearch Space=NAS-Bench-2012020.06 | 90.94 | |
| Randomtype=baseline2020.06 | 90.93 | |
| RSSearch (s)=12000, Search Strategy=Non-weight sharing2020.06 | 90.93 | |
| RSSearch Time (s)=12000, Search Approach=Non-weight sharing2021.02 | 90.93 | |
| RSSearch space=hand crafted, Parameter sharing=false, LLM-based=false, Search (archs)=5002026.04 | 90.93 | |
| RSSearch (archs)=500, Search space=hand-crafted search space, Parameter sharing=false, LLM-based=false2026.05 | 90.93 | |
| ReNASsearch seconds=86.312024.02 | 90.9 | |
| LeMo-NADe(GPT4)Search space=open-ended NAS, LLM-based=true, Search (archs)=302026.04 | 90.9 | |
| LeMo-NADe(GPT4)Search (archs)=30, Search space=open-ended NAS, LLM-based=true2026.05 | 90.9 | |
| AutoMCUSearch (Archs)=10, LLM=DeepSeek-V3.2, Temperature=02026.05 | 90.89 | |
| ResNet2020.06 | 90.83 | |
| ResNetSearch Dataset Protocol=Direct search on evaluation dataset2022.06 | 90.83 | |
| ResNetType=Manual2022.11 | 90.83 | |
| ResNet2024.02 | 90.83 | |
| ResNetSearch (archs)=-2026.04 | 90.83 | |
| ResNetSearch (archs)=-, Search space=hand-crafted search space, LLM-based=false2026.05 | 90.83 | |
| BOHBSearch Space=NAS-Bench-2012020.06 | 90.82 | |
| BOHBSearch (s)=12000, Search Strategy=Non-weight sharing2020.06 | 90.82 | |
| BOHBSearch Time (s)=12000, Search Approach=Non-weight sharing2021.02 | 90.82 | |
| BOHBsearch seconds=3.592024.02 | 90.82 | |
| BOHBSearch space=hand crafted, Parameter sharing=false, LLM-based=false, Search (archs)=5002026.04 | 90.82 | |
| BOHBSearch (archs)=500, Search space=hand-crafted search space, Parameter sharing=false, LLM-based=false2026.05 | 90.82 | |
| GENIUSSearch (Archs)=10, LLM=DeepSeek-V3.2, Temperature=02026.05 | 90.82 | |
| NoisyDARTSCost (hrs)=3.22020.05 | 90.26 | |
| MIDASSearch Dataset=CIFAR-1002026.02 | 90.2 | |
| SNAS2020.06 | 90.1 | |
| SNAS2020.05 | 90.1 | |
| SNASSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.04 | 90.1 | |
| SNASSearch (archs)=-, Search space=hand-crafted search space, Parameter sharing=true, LLM-based=false2026.05 | 90.1 | |
| Random Samplesearch seconds=0.012024.02 | 90.03 | |
| GDAS2020.06 | 90.01 | |
| GDASSearch (s)=28926, Search Strategy=Weight sharing2020.06 | 90 | |
| GDASSearch Time (s)=28926, Search Approach=Weight sharing2021.02 | 90 | |
| OptimalSearch Approach=Optimal, Sample Size (N)=102021.02 | 90 | |
| GDASType=One-shot2022.11 | 90 | |
| GDASsearch seconds=28925.912024.02 | 90 | |
| PC-DARTS2020.06 | 89.96 | |
| PCDARTS2020.05 | 89.96 | |
| PC-DARTSType=One-shot2022.11 | 89.96 | |
| PC-DARTS2026.02 | 89.96 | |
| PC-DARTSSearch space=hand crafted, Parameter sharing=true, LLM-based=false, Search (archs)=-2026.04 | 89.96 | |
| PC-DARTSSearch (archs)=-, Search space=hand-crafted search space, Parameter sharing=true, LLM-based=false2026.05 | 89.96 | |
| OptimalSearch (s)=N/A, Sample size N=10, Search Strategy=Training-free2020.06 | 89.92 | |
| NAS-WOTSearch Time (s)=25.7, Search Approach=Training-free, Sample Size (N)=1002021.02 | 89.91 | |
| EPE-NASSearch Time (s)=2.3, Search Approach=Training-free, Sample Size (N)=102021.02 | 89.9 | |
| GDASCost (hours)=8.72020.09 | 89.89 |