# Biomed-DPT: Dual Modality Prompt Tuning for Biomedical Vision-Language Models

Source: [Biomed-DPT: Dual Modality Prompt Tuning for Biomedical Vision-Language Models](<https://www.sota2.com/research/paper/68fa787d1e209131cea78a8b>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T06:52:53.434Z

Authors: Wei Peng, Kang Liu, Jianchen Hu, Meng Zhang

Published: 2025-05-08T12:37:51.000Z

## Abstract

Prompt learning is one of the most effective paradigms for adapting pre-trained vision-language models (VLMs) to the biomedical image classification tasks in few shot scenarios. However, most of the current prompt learning methods only used the text prompts and ignored the particular structures (such as the complex anatomical structures and subtle pathological features) in the biomedical images. In this work, we propose Biomed-DPT, a knowledge-enhanced dual modality prompt tuning technique. In designing the text prompt, Biomed-DPT constructs a dual prompt including the template-driven clinical prompts and the large language model (LLM)-driven domain-adapted prompts, then extracts the clinical knowledge from the domain-adapted prompts through the knowledge distillation technique. In designing the vision prompt, Biomed-DPT introduces the zero vector as a soft prompt to leverage attention re-weighting so that the focus on non-diagnostic regions and the recognition of non-critical pathological features are avoided. Biomed-DPT achieves an average classification accuracy of 66.14\\% across 11 biomedical image datasets covering 9 modalities and 10 organs, with performance reaching 78.06\\% in base classes and 75.97\\% in novel classes, surpassing the Context Optimization (CoOp) method by 6.20\\%, 3.78\\%, and 8.04\\%, respectively. Our code are available at \\underline{https://github.com/Kanyooo/Biomed-DPT}.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Biomedical Classification on 11 Biomedical Datasets Average (K-shot/Zero-shot)](<https://www.sota2.com/research/sota/biomedical-classification-on-11-biomedical-datasets-average-k-shot-zero-shot.md>): Biomedical Classification; 11 biomedical datasets Average; Accuracy (K=1): 59.03.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2505.05189>)

[PDF](<https://arxiv.org/pdf/2505.05189.pdf>)
