# ProtoTTA: Prototype-Guided Test-Time Adaptation

Source: [ProtoTTA: Prototype-Guided Test-Time Adaptation](<https://www.sota2.com/research/paper/69e5b30a7d0172140ec7df99>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-21T05:00:04.784Z

Authors: Mohammad Mahdi Abootorabi, Parvin Mousavi, Purang Abolmaesumi, Evan Shelhamer

Published: 2026-04-16T19:52:57.000Z

## Abstract

Deep networks that rely on prototypes-interpretable representations that can be related to the model input-have gained significant attention for balancing high accuracy with inherent interpretability, which makes them suitable for critical domains such as healthcare. However, these models are limited by their reliance on training data, which hampers their robustness to distribution shifts. While test-time adaptation (TTA) improves the robustness of deep networks by updating parameters and statistics, the prototypes of interpretable models have not been explored for this purpose. We introduce ProtoTTA, a general framework for prototypical models that leverages intermediate prototype signals rather than relying solely on model outputs. ProtoTTA minimizes the entropy of the prototype-similarity distribution to encourage more confident and prototype-specific activations on shifted data. To maintain stability, we employ geometric filtering to restrict updates to samples with reliable prototype activations, regularized by prototype-importance weights and model-confidence scores. Experiments across four prototypical backbones on four diverse benchmarks spanning fine-grained vision, histopathology, and NLP demonstrate that ProtoTTA improves robustness over standard output entropy minimization while restoring correct semantic focus in prototype activations. We also introduce novel interpretability metrics and a vision-language model (VLM) evaluation framework to explain TTA dynamics, confirming ProtoTTA restores human-aligned semantic focus and correlates reliably with VLM-rated reasoning quality. Code is available at: https://github.com/DeepRCL/ProtoTTA.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Histopathology Prostate Cancer Grading on SICAP C v2](<https://www.sota2.com/research/sota/histopathology-prostate-cancer-grading-on-sicap-c-v2.md>): Histopathology prostate cancer grading; SICAP C v2; Accuracy (Gaussian Noise): 59.4.

- [Bird Classification on CUB-200-C](<https://www.sota2.com/research/sota/bird-classification-on-cub-200-c.md>): Bird Classification; CUB-200-C; Accuracy (Gauss Noise): 52.

- [Test-Time Adaptation on CUB-200-C](<https://www.sota2.com/research/sota/test-time-adaptation-on-cub-200-c.md>): Test-time adaptation; CUB-200-C; Semantic Consistency (PAC): 91.9.

- [Interpretability Evaluation on CUB-200-C 100-sample](<https://www.sota2.com/research/sota/interpretability-evaluation-on-cub-200-c-100-sample.md>): Interpretability Evaluation; CUB-200-C 100-sample; Focus Relevance: 4.3.

- [Image Classification on SICAP C v2](<https://www.sota2.com/research/sota/image-classification-on-sicap-c-v2.md>): Image Classification; SICAP C v2; Semantic Consistency (PAC): 87.7.

- [Review Classification on Amazon-C v1 (test)](<https://www.sota2.com/research/sota/review-classification-on-amazon-c-v1-test.md>): Review classification; Amazon-C v1 (test); Qwerty Score: 82.2.

- [Test-Time Adaptation on Amazon-C](<https://www.sota2.com/research/sota/test-time-adaptation-on-amazon-c.md>): Test-time adaptation; Amazon c; Semantic Consistency (PAC): 18.2.

- [Image Classification on Stanford Dogs-C](<https://www.sota2.com/research/sota/image-classification-on-stanford-dogs-c.md>): Image Classification; Stanford Dogs-C; Semantic Consistency (PAC): 91.2.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2604.15494>)

[PDF](<https://arxiv.org/pdf/2604.15494.pdf>)
