# A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicine

Source: [A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicine](<https://www.sota2.com/research/paper/68fa76731e209131cea6d0fb>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T06:45:57.319Z

Authors: Hanguang Xiao, Feizhong Zhou, Xingyue Liu, Tianqi Liu, Zhipeng Li, Xin Liu, Xiaoxuan Huang

Published: 2024-05-14T13:42:05.000Z

## Abstract

Since the release of ChatGPT and GPT-4, large language models (LLMs) and multimodal large language models (MLLMs) have attracted widespread attention for their exceptional capabilities in understanding, reasoning, and generation, introducing transformative paradigms for integrating artificial intelligence into medicine. This survey provides a comprehensive overview of the development, principles, application scenarios, challenges, and future directions of LLMs and MLLMs in medicine. Specifically, it begins by examining the paradigm shift, tracing the transition from traditional models to LLMs and MLLMs, and highlighting the unique advantages of these LLMs and MLLMs in medical applications. Next, the survey reviews existing medical LLMs and MLLMs, providing detailed guidance on their construction and evaluation in a clear and systematic manner. Subsequently, to underscore the substantial value of LLMs and MLLMs in healthcare, the survey explores five promising applications in the field. Finally, the survey addresses the challenges confronting medical LLMs and MLLMs and proposes practical strategies and future directions for their integration into medicine. In summary, this survey offers a comprehensive analysis of the technical methodologies and practical clinical applications of medical LLMs and MLLMs, with the goal of bridging the gap between these advanced technologies and clinical practice, thereby fostering the evolution of the next generation of intelligent healthcare systems.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Ultrasound Question Answering on U2-Bench disease-diagnosis](<https://www.sota2.com/research/sota/ultrasound-question-answering-on-u2-bench-disease-diagnosis.md>): Ultrasound Question Answering; U2-Bench disease-diagnosis; Accuracy: 34.79.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2405.08603>)

[PDF](<https://arxiv.org/pdf/2405.08603.pdf>)
