# Medical Report Generation on Med-R2 (test) Source: [Medical Report Generation on Med-R2 (test)]() Collection index: [llms.txt]() Data updated: 2026-05-26T08:38:38.141Z Evaluation of models performing Medical Report Generation on the test split of the Med-R2 dataset, assessed using metrics like ROUGE-1 and BERTScore. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Medical Report Generation | | Dataset (including any stated split) | Med-R2 (test) | | Metric | ROUGE-1 | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 14 of 14 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [ROUGE-1](): Higher is better; unit: SCALAR. - [BERTScore](): Higher is better; unit: SCALAR. ## Recorded results | Method | ROUGE-1 | Result date | Report paper | | --- | --- | --- | --- | | Hulu-Med-7B | 14.6 | Not recorded | 6a15292fdbd7150506f7dfc9 | | Hulu-Med-14B | 14.5 | Not recorded | 6a15292fdbd7150506f7dfc9 | | Hulu-Med-4B | 13.7 | Not recorded | 6a15292fdbd7150506f7dfc9 | | Linshu-7B | 12.7 | Not recorded | 6a15292fdbd7150506f7dfc9 | | HuatuoGPT-Vision-34B | 12.5 | Not recorded | 6a15292fdbd7150506f7dfc9 | | Medgemma-4B | 10.9 | Not recorded | 6a15292fdbd7150506f7dfc9 | | Janus-Pro-7B | 10.3 | Not recorded | 6a15292fdbd7150506f7dfc9 | | Intern3-VL3-8B | 10.3 | Not recorded | 6a15292fdbd7150506f7dfc9 | | GPT-5.2-thinking | 9.9 | Not recorded | 6a15292fdbd7150506f7dfc9 | | Qwen3-VL-8B | 8.6 | Not recorded | 6a15292fdbd7150506f7dfc9 | | GPT-4o | 8.6 | Not recorded | 6a15292fdbd7150506f7dfc9 | | HuatuoGPT-Vision-7B | 8.5 | Not recorded | 6a15292fdbd7150506f7dfc9 | | Qwen3-VL-235b | 7.9 | Not recorded | 6a15292fdbd7150506f7dfc9 | | Qwen2.5-VL-7B | 7.8 | Not recorded | 6a15292fdbd7150506f7dfc9 | ### Hulu-Med-7B ROUGE-1: 14.6. Result ID: 6a155c07fbc373592c0cce89. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Medical Specific","Zero-shot":"true"}. This record does not assert independent reproduction. ### Hulu-Med-14B ROUGE-1: 14.5. Result ID: 6a155c07fbc373592c0cce8a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Medical Specific","Zero-shot":"true"}. This record does not assert independent reproduction. ### Hulu-Med-4B ROUGE-1: 13.7. Result ID: 6a155c07fbc373592c0cce88. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Medical Specific","Zero-shot":"true"}. This record does not assert independent reproduction. ### Linshu-7B ROUGE-1: 12.7. Result ID: 6a155c07fbc373592c0cce8b. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Medical Specific","Zero-shot":"true"}. This record does not assert independent reproduction. ### HuatuoGPT-Vision-34B ROUGE-1: 12.5. Result ID: 6a155c07fbc373592c0cce8e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Medical Specific","Zero-shot":"true"}. This record does not assert independent reproduction. ### Medgemma-4B ROUGE-1: 10.9. Result ID: 6a155c07fbc373592c0cce8c. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Medical Specific","Zero-shot":"true"}. This record does not assert independent reproduction. ### Janus-Pro-7B ROUGE-1: 10.3. Result ID: 6a155c07fbc373592c0cce8f. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Open Source","Zero-shot":"true"}. This record does not assert independent reproduction. ### Intern3-VL3-8B ROUGE-1: 10.3. Result ID: 6a155c07fbc373592c0cce90. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Open Source","Zero-shot":"true"}. This record does not assert independent reproduction. ### GPT-5.2-thinking ROUGE-1: 9.9. Result ID: 6a155c07fbc373592c0cce94. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Proprietary","Zero-shot":"true"}. This record does not assert independent reproduction. ### Qwen3-VL-8B ROUGE-1: 8.6. Result ID: 6a155c07fbc373592c0cce91. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Open Source","Zero-shot":"true"}. This record does not assert independent reproduction. ### GPT-4o ROUGE-1: 8.6. Result ID: 6a155c07fbc373592c0cce93. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Proprietary","Zero-shot":"true"}. This record does not assert independent reproduction. ### HuatuoGPT-Vision-7B ROUGE-1: 8.5. Result ID: 6a155c07fbc373592c0cce8d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Medical Specific","Zero-shot":"true"}. This record does not assert independent reproduction. ### Qwen3-VL-235b ROUGE-1: 7.9. Result ID: 6a155c07fbc373592c0cce95. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Proprietary","Zero-shot":"true"}. This record does not assert independent reproduction. ### Qwen2.5-VL-7B ROUGE-1: 7.8. Result ID: 6a155c07fbc373592c0cce92. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Open Source","Zero-shot":"true"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.