NAS-Bench
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
NAS-Bench-201 ImageNet-16-120 (test)
58.92Accuracy
140
NAS-Bench-201 CIFAR-10 (test)
94.37Accuracy
110
NAS-Bench-201 CIFAR-100 (test)
73.51Accuracy
103
NAS-Bench-201 CIFAR-100
73.49Accuracy
24
NAS-Bench-101 1.0 (test)
0.943Test Accuracy
22
NAS-Bench-101 (test)
0.871Kendall's Tau
18
NAS-Bench-101 depth=2~7, Test Samples=all 1.0
0.891Kendall's Tau
17
NAS-Bench-201 CIFAR-100
0.911Spearman Correlation
13
NAS-Bench-101 CIFAR-10
0.832Spearman Correlation
13
NAS-Bench-101 (test)
2Ranking
11
NAS-Bench-101 CIFAR-10 1.0 (S424)
80.1Kendall's Tau
11
NAS-Bench-201 ImageNet16 (test)
0.63Kendall's Tau
9
NAS-Bench CIFAR-100 201 (test)
0.65Kendall's Tau
9
NAS-Bench-360
0.007Darcy (Relative L2)
9
NAS-Bench-101 depth=2~7, Test Samples=100 1.0
0.801Kendall's Tau
9
NAS-Bench-201
100Validity
8
NAS-Bench-101 CIFAR-10 1.0 (S848)
78.2Kendall's Tau
8
NAS-Bench-201 (NB201) (val)
91.61Acc (C10)
7
NAS-Bench-301 (val)
94.92Accuracy
6
NAS-Bench-201 CIFAR-10 1.0 (S781)
83.2Kendall's Tau
6
NAS-Bench-201 CIFAR-10 1.0 (S469)
80.6Kendall's Tau
6
NAS-Bench-201 CIFAR-10 1.0 (S156)
0.706Kendall's Tau
6
NAS-Bench-201
0.935Kendall's Tau
6
NAS-Bench-201
3,689Computation Time (s)
5
NAS-Bench-301 CIFAR-10
0.74Spearman rho
4