Neural Architecture Search Performance Prediction on NAS-Bench-201 (test)
0.9259Kendall's TauGATES
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GATESProportion of training samples=100%2020.04 | 0.9259 | — | — | |
| GATESProportion of training samples=50%2020.04 | 0.9192 | — | — | |
| LSTMProportion of training samples=100%2020.04 | 0.9002 | — | — | |
| GATESProportion of training samples=10%2020.04 | 0.8802 | — | — | |
| LSTMProportion of training samples=50%2020.04 | 0.8791 | — | — | |
| MLPProportion of training samples=100%2020.04 | 0.8703 | — | — | |
| GATESProportion of training samples=5%2020.04 | 0.8628 | — | — | |
| MLPProportion of training samples=50%2020.04 | 0.8229 | — | — | |
| GATESProportion of training samples=1%2020.04 | 0.7401 | — | — | |
| LSTMProportion of training samples=10%2020.04 | 0.7268 | — | — | |
| Arch-Graph2022.04 | 0.67 | 73.38 | 0.79 | |
| LSTMProportion of training samples=5%2020.04 | 0.6407 | — | — | |
| LSTMProportion of training samples=1%2020.04 | 0.555 | — | — | |
| MLPProportion of training samples=10%2020.04 | 0.5388 | — | — | |
| weakNAS2022.04 | 0.49 | 73.42 | 0.56 | |
| BONAS2022.04 | 0.43 | 72.84 | 0.6 | |
| MLPProportion of training samples=5%2020.04 | 0.3959 | — | — | |
| MLPProportion of training samples=1%2020.04 | 0.0974 | — | — | |
| REA2022.04 | — | 72.7 | — | |
| RS2022.04 | — | 71.8 | — |