# MetaLR: Meta-tuning of Learning Rates for Transfer Learning in Medical Imaging

Source: [MetaLR: Meta-tuning of Learning Rates for Transfer Learning in Medical Imaging](<https://www.sota2.com/research/paper/68fa6f761e209131cea45b91>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-01-04T05:15:14.603Z

Authors: Yixiong Chen, Li Liu, Jingxian Li, Hua Jiang, Chris Ding, Zongwei Zhou

Published: 2022-06-03T06:31:11.000Z

## Abstract

In medical image analysis, transfer learning is a powerful method for deep neural networks (DNNs) to generalize well on limited medical data. Prior efforts have focused on developing pre-training algorithms on domains such as lung ultrasound, chest X-ray, and liver CT to bridge domain gaps. However, we find that model fine-tuning also plays a crucial role in adapting medical knowledge to target tasks. The common fine-tuning method is manually picking transferable layers (e.g., the last few layers) to update, which is labor-expensive. In this work, we propose a meta-learning-based LR tuner, named MetaLR, to make different layers automatically co-adapt to downstream tasks based on their transferabilities across domains. MetaLR learns appropriate LRs for different layers in an online manner, preventing highly transferable layers from forgetting their medical representation abilities and driving less transferable layers to adapt actively to new domains. Extensive experiments on various medical applications show that MetaLR outperforms previous state-of-the-art (SOTA) fine-tuning strategies. Codes are released.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Lesion Detection on BUSI](<https://www.sota2.com/research/sota/lesion-detection-on-busi.md>): Lesion Detection; BUSI; Training Time (m): 6.

- [Lesion Detection on POCUS](<https://www.sota2.com/research/sota/lesion-detection-on-pocus.md>): Lesion Detection; POCUS; Training Time (m): 24.8.

- [Lesion Detection on Chest X-ray](<https://www.sota2.com/research/sota/lesion-detection-on-chest-x-ray.md>): Lesion Detection; Chest X-ray; Training Time (m): 26.3.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2206.01408>)

[PDF](<https://arxiv.org/pdf/2206.01408.pdf>)
