# D\\'ej\\\`a Vu: an empirical evaluation of the memorization properties of ConvNets

Source: [D\\'ej\\\`a Vu: an empirical evaluation of the memorization properties of ConvNets](<https://www.sota2.com/research/paper/68fa64e01e209131cea06fb8>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T21:13:58.604Z

Authors: Alexandre Sablayrolles, Matthijs Douze, Cordelia Schmid, Herv\\'e J\\'egou

Published: 2018-09-17T18:25:08.000Z

## Abstract

Convolutional neural networks memorize part of their training data, which is why strategies such as data augmentation and drop-out are employed to mitigate overfitting. This paper considers the related question of "membership inference", where the goal is to determine if an image was used during training. We consider it under three complementary angles. We show how to detect which dataset was used to train a model, and in particular whether some validation images were used at train time. We then analyze explicit memorization and extend classical random label experiments to the problem of learning a model that predicts if an image belongs to an arbitrary set. Finally, we propose a new approach to infer membership when a few of the top layers are not available or have been fine-tuned, and show that lower layers still carry information about the training samples. To support our findings, we conduct large-scale experiments on Imagenet and subsets of YFCC-100M with modern architectures such as VGG and Resnet.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1809.06396>)

[PDF](<https://arxiv.org/pdf/1809.06396.pdf>)
