# Comparison between layer-to-layer network training and conventional network training using Deep Convolutional Neural Networks

Source: [Comparison between layer-to-layer network training and conventional network training using Deep Convolutional Neural Networks](<https://www.sota2.com/research/paper/68fa6f461e209131cea44b0e>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T01:16:36.929Z

Authors: Kiran Kumar Ashish Bhyravabhottla, WonSook Lee

Published: 2023-03-27T14:29:18.000Z

## Abstract

Title: Comparison between layer-to-layer network training and conventional network training using Deep Convolutional Neural Networks   Abstract: Convolutional neural networks (CNNs) are widely used in various applications due to their effectiveness in extracting features from data. However, the performance of a CNN heavily depends on its architecture and training process. In this study, we propose a layer-to-layer training method and compare its performance with the conventional training method.   In the layer-to-layer training approach, we treat a portion of the early layers as a student network and the later layers as a teacher network. During each training step, we incrementally train the student network to learn from the output of the teacher network, and vice versa. We evaluate this approach on VGG16, ResNext, and DenseNet networks without pre-trained ImageNet weights and a regular CNN model.   Our experiments show that the layer-to-layer training method outperforms the conventional training method for both models. Specifically, we achieve higher accuracy on the test set for the VGG16, ResNext, and DeseNet networks and the CNN model using layer-to-layer training compared to the conventional training method.   Overall, our study highlights the importance of layer-wise training in CNNs and suggests that layer-to-layer training can be a promising approach for improving the accuracy of CNNs.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2303.15245>)

[PDF](<https://arxiv.org/pdf/2303.15245.pdf>)
