Medical Caption Generation on Inhouse-Abdomen 1 (external)
0.2509RaTE ScoreAstra
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Astraconfidence_interval=95%, bootstrap_iterations=2,0002026.05 | 0.2509 | 0.3029 | 0.35 | 0.2169 | 0.0631 | 0.2332 | |
| HuluMed-32Bconfidence_interval=95%, bootstrap_iterations=2,0002026.05 | 0.2035 | 0.1684 | 0.1722 | 0.1396 | 0.0598 | 0.135 | |
| MedGemma-4Bconfidence_interval=95%, bootstrap_iterations=2,0002026.05 | 0.1876 | 0.0463 | 0.1456 | 0.0901 | 0.0218 | 0.076 | |
| MedGemma-27Bconfidence_interval=95%, bootstrap_iterations=2,0002026.05 | 0.1871 | 0.0315 | 0.1184 | 0.0373 | 0.0252 | 0.0531 | |
| HuluMed-7Bconfidence_interval=95%, bootstrap_iterations=2,0002026.05 | 0.1853 | 0.1032 | 0.133 | 0.078 | 0.0365 | 0.0877 | |
| Lingshu-32Bconfidence_interval=95%, bootstrap_iterations=2,0002026.05 | 0.1841 | 0.0594 | 0.0921 | 0.0656 | 0.0118 | 0.0572 | |
| M3Dconfidence_interval=95%, bootstrap_iterations=2,0002026.05 | 0.184 | 0.0944 | 0.1145 | 0.0615 | 0.026 | 0.0741 | |
| Qwen3-VL-8Bconfidence_interval=95%, bootstrap_iterations=2,0002026.05 | 0.1699 | 0.0405 | 0.0631 | 0.0285 | 0 | 0.0331 | |
| Gemini-3confidence_interval=95%, bootstrap_iterations=2,0002026.05 | 0.1659 | 0.0391 | 0.0558 | 0.0322 | 0.0141 | 0.0353 | |
| HuluMed-14Bconfidence_interval=95%, bootstrap_iterations=2,0002026.05 | 0.1626 | 0.0502 | 0.0546 | 0.0414 | 0.0134 | 0.0399 | |
| Lingshu-7Bconfidence_interval=95%, bootstrap_iterations=2,0002026.05 | 0.1605 | 0.0247 | 0.0474 | 0.0174 | 0 | 0.0224 | |
| RadFMconfidence_interval=95%, bootstrap_iterations=2,0002026.05 | 0.1513 | 0.0133 | 0.0268 | 0.0266 | 0.0155 | 0.0205 |