# Meta Architecture Search

Source: [Meta Architecture Search](<https://www.sota2.com/research/paper/68fa66b01e209131cea11cb6>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T06:00:46.575Z

Authors: Albert Shaw, Wei Wei, Weiyang Liu, Le Song, Bo Dai

Published: 2018-12-22T19:25:08.000Z

## Abstract

Neural Architecture Search (NAS) has been quite successful in constructing state-of-the-art models on a variety of tasks. Unfortunately, the computational cost can make it difficult to scale. In this paper, we make the first attempt to study Meta Architecture Search which aims at learning a task-agnostic representation that can be used to speed up the process of architecture search on a large number of tasks. We propose the Bayesian Meta Architecture SEarch (BASE) framework which takes advantage of a Bayesian formulation of the architecture search problem to learn over an entire set of tasks simultaneously. We show that on Imagenet classification, we can find a model that achieves 25.7% top-1 error and 8.1% top-5 error by adapting the architecture in less than an hour from an 8 GPU days pretrained meta-network. By learning a good prior for NAS, our method dramatically decreases the required computation cost while achieving comparable performance to current state-of-the-art methods - even finding competitive models for unseen datasets with very quick adaptation. We believe our framework will open up new possibilities for efficient and massively scalable architecture search research across multiple tasks.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Image Classification on ImageNet (test)](<https://www.sota2.com/research/sota/image-classification-on-imagenet-test.md>): Image Classification; ImageNet (test); Top-1 Acc: not recorded.

- [5-way Few-Shot Classification Accuracy on miniImageNet (test)](<https://www.sota2.com/research/sota/5-way-few-shot-classification-accuracy-on-miniimagenet-test.md>): 5-way Classification; miniImageNet (test); Accuracy: not recorded.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1812.09584>)

[PDF](<https://arxiv.org/pdf/1812.09584.pdf>)
