# Data-Free Model Extraction

Source: [Data-Free Model Extraction](<https://www.sota2.com/research/paper/68fa69b21e209131cea2381d>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T23:06:39.153Z

Authors: Jean-Baptiste Truong, Pratyush Maini, Robert J. Walls, Nicolas Papernot

Published: 2020-11-30T13:37:47.000Z

## Abstract

Current model extraction attacks assume that the adversary has access to a surrogate dataset with characteristics similar to the proprietary data used to train the victim model. This requirement precludes the use of existing model extraction techniques on valuable models, such as those trained on rare or hard to acquire datasets. In contrast, we propose data-free model extraction methods that do not require a surrogate dataset. Our approach adapts techniques from the area of data-free knowledge transfer for model extraction. As part of our study, we identify that the choice of loss is critical to ensuring that the extracted model is an accurate replica of the victim model. Furthermore, we address difficulties arising from the adversary's limited access to the victim model in a black-box setting. For example, we recover the model's logits from its probability predictions to approximate gradients. We find that the proposed data-free model extraction approach achieves high-accuracy with reasonable query complexity -- 0.99x and 0.92x the victim model accuracy on SVHN and CIFAR-10 datasets given 2M and 20M queries respectively.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Model Stealing on CIFAR-10 (test)](<https://www.sota2.com/research/sota/model-stealing-on-cifar-10-test.md>): Model Stealing; CIFAR-10 (test); Synthetic Accuracy (Data-Free): 88.1.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2011.14779>)

[PDF](<https://arxiv.org/pdf/2011.14779.pdf>)
