# Diffusion-TTA: Test-time Adaptation of Discriminative Models via Generative Feedback

Source: [Diffusion-TTA: Test-time Adaptation of Discriminative Models via Generative Feedback](<https://www.sota2.com/research/paper/68fa715b1e209131cea50ccc>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T02:04:39.575Z

Authors: Mihir Prabhudesai, Tsung-Wei Ke, Alexander C. Li, Deepak Pathak, Katerina Fragkiadaki

Published: 2023-11-27T18:59:53.000Z

## Abstract

The advancements in generative modeling, particularly the advent of diffusion models, have sparked a fundamental question: how can these models be effectively used for discriminative tasks? In this work, we find that generative models can be great test-time adapters for discriminative models. Our method, Diffusion-TTA, adapts pre-trained discriminative models such as image classifiers, segmenters and depth predictors, to each unlabelled example in the test set using generative feedback from a diffusion model. We achieve this by modulating the conditioning of the diffusion model using the output of the discriminative model. We then maximize the image likelihood objective by backpropagating the gradients to discriminative model's parameters. We show Diffusion-TTA significantly enhances the accuracy of various large-scale pre-trained discriminative models, such as, ImageNet classifiers, CLIP models, image pixel labellers and image depth predictors. Diffusion-TTA outperforms existing test-time adaptation methods, including TTT-MAE and TENT, and particularly shines in online adaptation setups, where the discriminative model is continually adapted to each example in the test set. We provide access to code, results, and visualizations on our website: https://diffusion-tta.github.io/.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Image Classification on ImageNet-C (test)](<https://www.sota2.com/research/sota/image-classification-on-imagenet-c-test.md>): Image Classification; ImageNet-C (test); Defocus Blur Acc: 54.1.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2311.16102>)

[PDF](<https://arxiv.org/pdf/2311.16102.pdf>)
