# NAS Proxy Evaluation on NATS-Bench SSS ImageNet16-120 (stratified subset) Source: [NAS Proxy Evaluation on NATS-Bench SSS ImageNet16-120 (stratified subset)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:51:49.145Z Evaluation of NAS proxy metrics using Mean absolute Spearman correlation coefficient on the stratified subset of NATS-Bench Size Search Space (SSS) for ImageNet-16-120. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | NAS Proxy Evaluation | | Dataset (including any stated split) | NATS-Bench SSS (Size Search Space) ImageNet16-120 stratified subset | | Metric | Mean Absolute Spearman Correlation Coefficient | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 12 of 12 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Mean Absolute Spearman Correlation Coefficient](): Higher is better; unit: SCALAR. ## Recorded results | Method | Mean Absolute Spearman Correlation Coefficient | Result date | Report paper | | --- | --- | --- | --- | | GM-2 | 0.971 | Not recorded | 68fa75d31e209131cea6a0ef | | ZiCo | 0.949 | Not recorded | 68fa75d31e209131cea6a0ef | | GM-3 | 0.942 | Not recorded | 68fa75d31e209131cea6a0ef | | EZNAS | 0.888 | Not recorded | 68fa75d31e209131cea6a0ef | | Synflow | 0.87 | Not recorded | 68fa75d31e209131cea6a0ef | | GM-1 | 0.868 | Not recorded | 68fa75d31e209131cea6a0ef | | #Params | 0.769 | Not recorded | 68fa75d31e209131cea6a0ef | | Zen-NAS | 0.764 | Not recorded | 68fa75d31e209131cea6a0ef | | Gradnorm | 0.671 | Not recorded | 68fa75d31e209131cea6a0ef | | TE-NAS | 0.51 | Not recorded | 68fa75d31e209131cea6a0ef | | NASWOT | 0.488 | Not recorded | 68fa75d31e209131cea6a0ef | | Random | 0.062 | Not recorded | 68fa75d31e209131cea6a0ef | ### GM-2 Mean Absolute Spearman Correlation Coefficient: 0.971. Result ID: 699401113a6c3148491a3af7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Search Space":"SSS"}. This record does not assert independent reproduction. ### ZiCo Mean Absolute Spearman Correlation Coefficient: 0.949. Result ID: 699401113a6c3148491a3af4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Search Space":"SSS"}. This record does not assert independent reproduction. ### GM-3 Mean Absolute Spearman Correlation Coefficient: 0.942. Result ID: 699401113a6c3148491a3af8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Search Space":"SSS"}. This record does not assert independent reproduction. ### EZNAS Mean Absolute Spearman Correlation Coefficient: 0.888. Result ID: 699401113a6c3148491a3af5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Search Space":"SSS"}. This record does not assert independent reproduction. ### Synflow Mean Absolute Spearman Correlation Coefficient: 0.87. Result ID: 699401113a6c3148491a3aef. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Search Space":"SSS"}. This record does not assert independent reproduction. ### GM-1 Mean Absolute Spearman Correlation Coefficient: 0.868. Result ID: 699401113a6c3148491a3af6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Search Space":"SSS"}. This record does not assert independent reproduction. ### #Params Mean Absolute Spearman Correlation Coefficient: 0.769. Result ID: 699401113a6c3148491a3aee. [Reporting paper]() Recorded evaluation configuration: {"Search Space":"SSS"}. This record does not assert independent reproduction. ### Zen-NAS Mean Absolute Spearman Correlation Coefficient: 0.764. Result ID: 699401113a6c3148491a3af3. [Reporting paper]() Recorded evaluation configuration: {"Search Space":"SSS"}. This record does not assert independent reproduction. ### Gradnorm Mean Absolute Spearman Correlation Coefficient: 0.671. Result ID: 699401113a6c3148491a3af0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Search Space":"SSS"}. This record does not assert independent reproduction. ### TE-NAS Mean Absolute Spearman Correlation Coefficient: 0.51. Result ID: 699401113a6c3148491a3af2. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Search Space":"SSS"}. This record does not assert independent reproduction. ### NASWOT Mean Absolute Spearman Correlation Coefficient: 0.488. Result ID: 699401113a6c3148491a3af1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Search Space":"SSS"}. This record does not assert independent reproduction. ### Random Mean Absolute Spearman Correlation Coefficient: 0.062. Result ID: 699401113a6c3148491a3aed. [Reporting paper]() Recorded evaluation configuration: {"Search Space":"SSS"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.