# C2S2: Cost-aware Channel Sparse Selection for Progressive Network Pruning

Source: [C2S2: Cost-aware Channel Sparse Selection for Progressive Network Pruning](<https://www.sota2.com/research/paper/68fa659f1e209131cea0b497>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T21:30:43.473Z

Authors: Chih-Yao Chiu, Hwann-Tzong Chen, Tyng-Luh Liu

Published: 2019-04-06T18:40:06.000Z

## Abstract

This paper describes a channel-selection approach for simplifying deep neural networks. Specifically, we propose a new type of generic network layer, called pruning layer, to seamlessly augment a given pre-trained model for compression. Each pruning layer, comprising $1 \\times 1$ depth-wise kernels, is represented with a dual format: one is real-valued and the other is binary. The former enables a two-phase optimization process of network pruning to operate with an end-to-end differentiable network, and the latter yields the mask information for channel selection. Our method progressively performs the pruning task layer-wise, and achieves channel selection according to a sparsity criterion to favor pruning more channels. We also develop a cost-aware mechanism to prevent the compression from sacrificing the expected network performance. Our results for compressing several benchmark deep networks on image classification and semantic segmentation are comparable to those by state-of-the-art.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1904.03508>)

[PDF](<https://arxiv.org/pdf/1904.03508.pdf>)
