# Till the Layers Collapse: Compressing a Deep Neural Network through the Lenses of Batch Normalization Layers

Source: [Till the Layers Collapse: Compressing a Deep Neural Network through the Lenses of Batch Normalization Layers](<https://www.sota2.com/research/paper/68fa764a1e209131cea6c2a7>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T03:50:30.323Z

Authors: Zhu Liao, Nour Hezbri, Victor Qu\\'etu, Van-Tam Nguyen, Enzo Tartaglione

Published: 2024-12-19T17:26:07.000Z

## Abstract

Today, deep neural networks are widely used since they can handle a variety of complex tasks. Their generality makes them very powerful tools in modern technology. However, deep neural networks are often overparameterized. The usage of these large models consumes a lot of computation resources. In this paper, we introduce a method called \\textbf{T}ill the \\textbf{L}ayers \\textbf{C}ollapse (TLC), which compresses deep neural networks through the lenses of batch normalization layers. By reducing the depth of these networks, our method decreases deep neural networks' computational requirements and overall latency. We validate our method on popular models such as Swin-T, MobileNet-V2, and RoBERTa, across both image classification and natural language processing (NLP) tasks.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2412.15077>)

[PDF](<https://arxiv.org/pdf/2412.15077.pdf>)