# Hardware-Aware Neural Architecture Search on HW-NAS-Bench CIFAR-10 (test)

Source: [Hardware-Aware Neural Architecture Search on HW-NAS-Bench CIFAR-10 (test)](<https://www.sota2.com/research/sota/hardware-aware-neural-architecture-search-on-hw-nas-bench-cifar-10-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-18T08:30:48.096Z

Evaluation of Neural Architecture Search performance specifically focusing on hardware constraints (latency and tradeoff) using the HW-NAS-Bench dataset on CIFAR-10 test split.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Hardware-Aware Neural Architecture Search |
| Dataset (including any stated split) | HW-NAS-Bench CIFAR-10 (test) |
| Metric | Latency (%) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 6 of 6 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Latency (%)](<https://www.sota2.com/research/sota/hardware-aware-neural-architecture-search-on-hw-nas-bench-cifar-10-test.md?metric=Latency%20(%25)>): Higher is better; unit: PERCENT.

- [Test Accuracy](<https://www.sota2.com/research/sota/hardware-aware-neural-architecture-search-on-hw-nas-bench-cifar-10-test.md?metric=Test%20Accuracy>): Higher is better; unit: PERCENT.

- [Tradeoff Score](<https://www.sota2.com/research/sota/hardware-aware-neural-architecture-search-on-hw-nas-bench-cifar-10-test.md?metric=Tradeoff%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Latency (%) | Result date | Report paper |
| --- | --- | --- | --- |
| pFreeREA-top-K | 84.82 | Not recorded | 68fa77b31e209131cea74d66 |
| Random search | 30.16 | Not recorded | 68fa77b31e209131cea74d66 |
| Official HELP | 11 | Not recorded | 68fa77b31e209131cea74d66 |
| HELP-style | 4.51 | Not recorded | 68fa77b31e209131cea74d66 |
| HW-NAS with 10 Latency Probes | 4.4 | Not recorded | 68fa77b31e209131cea74d66 |
| HW-NAS with 10 Latency Probes | 1.65 | Not recorded | 68fa77b31e209131cea74d66 |

### pFreeREA-top-K

Latency (%): 84.82. Result ID: 6a0ace2e47f34ce924f0f0a6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77b31e209131cea74d66.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f431e209131cea449c2.md>)

Recorded evaluation configuration: {"Devices":"4","Lever":"\|N\| ↓","Measurement budget":"10"}. This record does not assert independent reproduction.

### Random search

Latency (%): 30.16. Result ID: 6a0ace2e47f34ce924f0f0a5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77b31e209131cea74d66.md>)

Recorded evaluation configuration: {"Devices":"4","Lever":"\|N\| ↓","Measurement budget":"10"}. This record does not assert independent reproduction.

### Official HELP

Latency (%): 11. Result ID: 6a0ace2e47f34ce924f0f0a9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77b31e209131cea74d66.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b611e209131cea2de3e.md>)

Recorded evaluation configuration: {"Devices":"3","Lever":"c ↓","Measurement budget":"10"}. This record does not assert independent reproduction.

### HELP-style

Latency (%): 4.51. Result ID: 6a0ace2e47f34ce924f0f0a7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77b31e209131cea74d66.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b611e209131cea2de3e.md>)

Recorded evaluation configuration: {"Devices":"4","Lever":"c ↓","Measurement budget":"10"}. This record does not assert independent reproduction.

### HW-NAS with 10 Latency Probes

Latency (%): 4.4. Result ID: 6a0ace2e47f34ce924f0f0aa.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77b31e209131cea74d66.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77b31e209131cea74d66.md>)

Recorded evaluation configuration: {"Devices":"3","Lever":"\|N\| ↓","Measurement budget":"10"}. This record does not assert independent reproduction.

### HW-NAS with 10 Latency Probes

Latency (%): 1.65. Result ID: 6a0ace2e47f34ce924f0f0a8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77b31e209131cea74d66.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77b31e209131cea74d66.md>)

Recorded evaluation configuration: {"Devices":"4","Lever":"\|N\| ↓","Measurement budget":"10"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.