# Test-time Batch Statistics Calibration for Covariate Shift

Source: [Test-time Batch Statistics Calibration for Covariate Shift](<https://www.sota2.com/research/paper/68fa6afb1e209131cea2b7ee>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T23:37:16.577Z

Authors: Fuming You, Jingjing Li, Zhou Zhao

Published: 2021-10-06T08:45:03.000Z

## Abstract

Deep neural networks have a clear degradation when applying to the unseen environment due to the covariate shift. Conventional approaches like domain adaptation requires the pre-collected target data for iterative training, which is impractical in real-world applications. In this paper, we propose to adapt the deep models to the novel environment during inference. An previous solution is test time normalization, which substitutes the source statistics in BN layers with the target batch statistics. However, we show that test time normalization may potentially deteriorate the discriminative structures due to the mismatch between target batch statistics and source parameters. To this end, we present a general formulation $\\alpha$-BN to calibrate the batch statistics by mixing up the source and target statistics for both alleviating the domain shift and preserving the discriminative structures. Based on $\\alpha$-BN, we further present a novel loss function to form a unified test time adaptation framework Core, which performs the pairwise class correlation online optimization. Extensive experiments show that our approaches achieve the state-of-the-art performance on total twelve datasets from three topics, including model robustness to corruptions, domain generalization on image classification and semantic segmentation. Particularly, our $\\alpha$-BN improves 28.4\\% to 43.9\\% on GTA5 $\\rightarrow$ Cityscapes without any training, even outperforms the latest source-free domain adaptation method.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2110.04065>)

[PDF](<https://arxiv.org/pdf/2110.04065.pdf>)
