# Translation-Equivariance of Normalization Layers and Aliasing in Convolutional Neural Networks

Source: [Translation-Equivariance of Normalization Layers and Aliasing in Convolutional Neural Networks](<https://www.sota2.com/research/paper/68fa797c1e209131cea7dc34>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T06:55:51.510Z

Authors: J\\'er\\'emy Scanvic, Quentin Barth\\'elemy, Juli\\'an Tachella

Published: 2025-05-26T10:39:36.000Z

## Abstract

The design of convolutional neural architectures that are exactly equivariant to continuous translations is an active field of research. It promises to benefit scientific computing, notably by making existing imaging systems more physically accurate. Most efforts focus on the design of downsampling/pooling layers, upsampling layers and activation functions, but little attention is dedicated to normalization layers. In this work, we present a novel theoretical framework for understanding the equivariance of normalization layers to discrete shifts and continuous translations. We also determine necessary and sufficient conditions for normalization layers to be equivariant in terms of the dimensions they operate on. Using real feature maps from ResNet-18 and ImageNet, we test those theoretical results empirically and find that they are consistent with our predictions.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2505.19805>)

[PDF](<https://arxiv.org/pdf/2505.19805.pdf>)