Radiology Report Generation on CHEXPERT Plus
27.1R-LMedGemma-4B-IT
Evaluation results
| Method | Links | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| MedGemma-4B-ITAccess=Open-source, Parameters=4B2026.02 | 27.1 | — | — | — | — | — | — | — | — | 79 | 47.2 | 29.3 | — | — | — | — | — | |
| Lingshu-7BAccess=Open-source, Parameters=7B2026.02 | 26.5 | — | — | — | — | — | — | — | — | 79 | 45.4 | 26.8 | — | — | — | — | — | |
| Fleming-VL-8BAccess=Open-source, Parameters=8B2026.02 | 26.1 | — | — | — | — | — | — | — | — | 82.2 | 47.1 | 40.1 | — | — | — | — | — | |
| GPT-4.1Access=Closed-source2026.02 | 24.5 | — | — | — | — | — | — | — | — | 78.8 | 45.5 | 23.2 | — | — | — | — | — | |
| Gemini-2.5-FlashAccess=Closed-source2026.02 | 23.6 | — | — | — | — | — | — | — | — | 72.2 | 44.3 | 27.4 | — | — | — | — | — | |
| MedMO-8BAccess=Open-source, Parameters=8B2026.02 | 23.6 | — | — | — | — | — | — | — | — | 87.5 | 47.3 | 42.2 | — | — | — | — | — | |
| Qwen2.5VL-7BAccess=Open-source, Parameters=7B2026.02 | 22.2 | — | — | — | — | — | — | — | — | 62 | 41 | 17.2 | — | — | — | — | — | |
| Claude Sonnet 4Access=Closed-source2026.02 | 22 | — | — | — | — | — | — | — | — | 59.5 | 43.5 | 18.9 | — | — | — | — | — | |
| Qwen3VL-8BAccess=Open-source, Parameters=8B2026.02 | 21.9 | — | — | — | — | — | — | — | — | 67.4 | 44.4 | 37.9 | — | — | — | — | — | |
| HuatuoGPT-V-7BAccess=Open-source, Parameters=7B2026.02 | 21.3 | — | — | — | — | — | — | — | — | 64.7 | 44.2 | 19.3 | — | — | — | — | — | |
| MedVLM-R1-2BAccess=Open-source, Parameters=2B2026.02 | 20.9 | — | — | — | — | — | — | — | — | 43.5 | 38.9 | 15.5 | — | — | — | — | — | |
| InternVL3-8BAccess=Open-source, Parameters=8B2026.02 | 20.9 | — | — | — | — | — | — | — | — | 65.4 | 44.3 | 25.2 | — | — | — | — | — | |
| InternVL2.5-8BAccess=Open-source, Parameters=8B2026.02 | 20.6 | — | — | — | — | — | — | — | — | 58.5 | 43.1 | 19.7 | — | — | — | — | — | |
| Med-R1-2BAccess=Open-source, Parameters=2B2026.02 | 18.6 | — | — | — | — | — | — | — | — | 37.1 | 38.5 | 17.8 | — | — | — | — | — | |
| LLaVA-Med-7BAccess=Open-source, Parameters=7B2026.02 | 18.4 | — | — | — | — | — | — | — | — | 45.5 | 38.8 | 23.5 | — | — | — | — | — | |
| BioMediX2-8BAccess=Open-source, Parameters=8B2026.02 | 18.1 | — | — | — | — | — | — | — | — | 47.9 | 40.8 | 21.6 | — | — | — | — | — | |
| MedMO-4BAccess=Open-source, Parameters=4B2026.02 | 15.1 | — | — | — | — | — | — | — | — | 62.3 | 36.6 | 34.2 | — | — | — | — | — | |
| AM-MRG2026.03 | 0.282 | 0.109 | — | — | — | — | — | — | — | — | — | — | 0.396 | 0.318 | 0.336 | 0.173 | — | |
| MambaX-VL2026.03 | 0.276 | 0.112 | — | — | — | — | — | — | — | — | — | — | 0.377 | 0.319 | 0.335 | 0.157 | — | |
| Token-Mixer2026.03 | 0.27 | 0.091 | — | — | — | — | — | — | — | — | — | — | 0.309 | 0.27 | 0.288 | 0.135 | — | |
| R2GenGPT2026.03 | 0.266 | 0.101 | — | — | — | — | — | — | — | — | — | — | 0.315 | 0.244 | 0.26 | 0.145 | — | |
| XProNet2026.03 | 0.265 | 0.1 | — | — | — | — | — | — | — | — | — | — | 0.314 | 0.247 | 0.259 | 0.146 | — | |
| R2GenCSR2026.03 | 0.265 | 0.1 | — | — | — | — | — | — | — | — | — | — | 0.315 | 0.247 | 0.259 | 0.146 | — | |
| ORGan2026.03 | 0.261 | 0.086 | — | — | — | — | — | — | — | — | — | — | 0.288 | 0.287 | 0.277 | 0.135 | — | |
| R2GenCMN2026.03 | 0.256 | 0.087 | — | — | — | — | — | — | — | — | — | — | 0.329 | 0.241 | 0.231 | 0.127 | — | |
| WCL2026.03 | 0.253 | 0.084 | — | — | — | — | — | — | — | — | — | — | 0.335 | 0.259 | 0.256 | 0.126 | — | |
| CAMANet2026.03 | 0.249 | 0.083 | — | — | — | — | — | — | — | — | — | — | 0.328 | 0.224 | 0.216 | 0.118 | — | |
| R2Gen2026.03 | 0.246 | 0.081 | — | — | — | — | — | — | — | — | — | — | 0.318 | 0.2 | 0.181 | 0.113 | — | |
| CvT2Dis.2026.03 | 0.238 | 0.067 | — | — | — | — | — | — | — | — | — | — | 0.285 | 0.252 | 0.246 | 0.118 | — | |
| SWINV2-BERTTrain=M&C2025.05 | 0.234 | 0.056 | 0.201 | — | 0.277 | 0.366 | 0.495 | 0.56 | 0.532 | — | — | — | — | — | — | — | — | |
| SWINV2-BERTTrain=C2025.05 | 0.228 | 0.057 | 0.183 | — | 0.25 | 0.331 | 0.401 | 0.508 | 0.432 | — | — | — | — | — | — | — | — | |
| PromptMRG2026.03 | 0.222 | 0.095 | — | — | — | — | — | — | — | — | — | — | 0.258 | 0.265 | 0.281 | 0.121 | — | |
| DEER2026.03 | 0.222 | 0.058 | — | — | — | — | — | — | — | — | — | — | 0.371 | 0.387 | 0.355 | 0.112 | — | |
| RADARTrain=M2025.05 | 0.203 | 0.076 | 0.143 | — | 0.216 | 0.362 | 0.417 | 0.541 | 0.524 | — | — | — | — | — | — | — | — | |
| BACKBONETrain=M2025.05 | 0.203 | 0.073 | 0.143 | — | 0.206 | 0.282 | 0.437 | 0.477 | 0.466 | — | — | — | — | — | — | — | — | |
| SWINV2-BERTTrain=M2025.05 | 0.191 | 0.034 | 0.136 | — | 0.198 | 0.268 | 0.383 | 0.41 | 0.423 | — | — | — | — | — | — | — | — | |
| R2GenRL2026.03 | 0.186 | 0.035 | — | — | — | — | — | — | — | — | — | — | 0.193 | 0.229 | 0.196 | 0.101 | — | |
| BiMediX2-8BParameters=8B2026.03 | — | — | — | — | — | — | — | — | — | — | 40.8 | 21.6 | — | — | — | — | 43.3 | |
| Claude 4.5 Sonnet2026.03 | — | — | — | — | — | — | — | — | — | — | 47.4 | 22.5 | — | — | — | — | 48.1 | |
| EviAgentbackbone=Qwen3-VL-8B2026.03 | — | — | — | — | — | — | — | — | — | — | 49.8 | 30.4 | — | — | — | — | 48.8 | |
| Gemini-2.5-Flash2026.03 | — | — | — | — | — | — | — | — | — | — | 44.3 | 27.4 | — | — | — | — | 44 | |
| GPT-5.12026.03 | — | — | — | — | — | — | — | — | — | — | 48 | 27.5 | — | — | — | — | 49.2 | |
| HuatuoGPT-V-7BParameters=7B2026.03 | — | — | — | — | — | — | — | — | — | — | 44.2 | 19.3 | — | — | — | — | 39.4 | |
| InternVL2.5-8BParameters=8B2026.03 | — | — | — | — | — | — | — | — | — | — | 43.1 | 19.7 | — | — | — | — | 42.7 | |
| InternVL3-8BParameters=8B2026.03 | — | — | — | — | — | — | — | — | — | — | 44.3 | 25.2 | — | — | — | — | 43.7 | |
| Lingshu-7BParameters=7B2026.03 | — | — | — | — | — | — | — | — | — | — | 45.4 | 26.8 | — | — | — | — | 47.3 | |
| LLaVA-Med-7BParameters=7B2026.03 | — | — | — | — | — | — | — | — | — | — | 38.8 | 23.5 | — | — | — | — | 44 | |
| MedGemma-4B-ITParameters=4B2026.03 | — | — | — | — | — | — | — | — | — | — | 47.2 | 29.3 | — | — | — | — | 46.6 | |
| Qwen2.5-VL-7BParameters=7B2026.03 | — | — | — | — | — | — | — | — | — | — | 41 | 17.2 | — | — | — | — | 43.1 | |
| Qwen3-VL-8BParameters=8B2026.03 | — | — | — | — | — | — | — | — | — | — | 45.9 | 27.3 | — | — | — | — | 44.6 |