Medical Report Generation on AMOS-MM-Report
25.32PrecisionOurs w/ TIF-GRPO
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Ours w/ TIF-GRPO#Params=8B2026.05 | 25.32 | 43.93 | 32.12 | 95.34 | 77.09 | 60.03 | 24.52 | 49.57 | 16.19 | 27.35 | 57.27 | 80.26 | |
| Ours w/ TIF-GRPO#Params=4B2026.05 | 24.17 | 41.22 | 30.47 | 95.06 | 76.8 | 57.77 | 22.77 | 49.95 | 17.91 | 29.04 | 58.53 | 81.54 | |
| Ours w/ SFT#Params=4B2026.05 | 19.79 | 15.93 | 17.65 | 87.59 | 59.8 | 47.76 | 7.23 | 18.93 | 5.38 | 31.75 | 59.79 | 82.73 | |
| Fleming-VL-8B#Params=8B2026.05 | 17.49 | 0.27 | 0.53 | 7.34 | 55 | 10 | 0 | 0.23 | 0 | 17.9 | 44.91 | 75.02 | |
| GPT-5#Params=*2026.05 | 15.15 | 10.05 | 12.08 | 76.13 | 75.13 | 44.17 | 3.65 | 9.99 | 2.58 | 17.18 | 47.17 | 75.15 | |
| InternVL3.5-8B#Params=8B2026.05 | 11.66 | 1.54 | 2.71 | 20.64 | 52.34 | 23.59 | 0.21 | 1.43 | 0.04 | 19.03 | 48.82 | 76.04 | |
| Hulu-Med#Params=7B2026.05 | 10.4 | 8.09 | 7.6 | 44.31 | 55.93 | 37.26 | 1.74 | 7.97 | 1.16 | 16.56 | 49.96 | 74.85 | |
| Gemini-3-Pro#Params=*2026.05 | 10.26 | 10.48 | 10.33 | 87.24 | 55.6 | 40.97 | 3.09 | 11.46 | 1.99 | 19.07 | 47.51 | 75.77 | |
| M3D-LaMed#Params=7B2026.05 | 6.14 | 5.75 | 5.93 | 84.77 | 35.79 | 24.13 | 0.69 | 6.94 | 0.39 | 11.22 | 35.25 | 65.1 | |
| Qwen3-VL-8B#Params=8B2026.05 | 6.08 | 4.95 | 5.44 | 59.88 | 59.26 | 25.68 | 0.89 | 5.33 | 0.55 | 17.92 | 48.6 | 75.29 | |
| RadFM#Params=14B2026.05 | 4.64 | 2.41 | 3.17 | 48.49 | 38.57 | 20.52 | 0.3 | 2.91 | 0.19 | 11.65 | 33.54 | 68.63 | |
| CT-CHAT#Params=8B2026.05 | 1.33 | 0.6 | 0.82 | 70.51 | 69.44 | 11.11 | 0.02 | 0.31 | 0 | 18.03 | 40.58 | 72.47 |