# Rethinking Two Consensuses of the Transferability in Deep Learning

Source: [Rethinking Two Consensuses of the Transferability in Deep Learning](<https://www.sota2.com/research/paper/68fa6e231e209131cea3e174>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T00:50:11.375Z

Authors: Yixiong Chen, Jingxian Li, Chris Ding, Li Liu

Published: 2022-12-01T10:04:56.000Z

## Abstract

Deep transfer learning (DTL) has formed a long-term quest toward enabling deep neural networks (DNNs) to reuse historical experiences as efficiently as humans. This ability is named knowledge transferability. A commonly used paradigm for DTL is firstly learning general knowledge (pre-training) and then reusing (fine-tuning) them for a specific target task. There are two consensuses of transferability of pre-trained DNNs: (1) a larger domain gap between pre-training and downstream data brings lower transferability; (2) the transferability gradually decreases from lower layers (near input) to higher layers (near output). However, these consensuses were basically drawn from the experiments based on natural images, which limits their scope of application. This work aims to study and complement them from a broader perspective by proposing a method to measure the transferability of pre-trained DNN parameters. Our experiments on twelve diverse image classification datasets get similar conclusions to the previous consensuses. More importantly, two new findings are presented, i.e., (1) in addition to the domain gap, a larger data amount and huge dataset diversity of downstream target task also prohibit the transferability; (2) although the lower layers learn basic image features, they are usually not the most transferable layers due to their domain sensitivity.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Lesion Detection on BUSI](<https://www.sota2.com/research/sota/lesion-detection-on-busi.md>): Lesion Detection; BUSI; Training Time (m): 3.2.

- [Lesion Detection on POCUS](<https://www.sota2.com/research/sota/lesion-detection-on-pocus.md>): Lesion Detection; POCUS; Training Time (m): 12.

- [Lesion Detection on Chest X-ray](<https://www.sota2.com/research/sota/lesion-detection-on-chest-x-ray.md>): Lesion Detection; Chest X-ray; Training Time (m): 9.7.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2212.00399>)

[PDF](<https://arxiv.org/pdf/2212.00399.pdf>)
