Fine-grained Captioning on Inspect
33.05RaTE ScoreAstra
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Astra2026.05 | 33.05 | 36.01 | 44.49 | 37.93 | 40.28 | 39.68 | |
| R2GenGPT2026.05 | 29.07 | 28.3 | 37.19 | 31.39 | 31.3 | 32.04 | |
| LLaVA2026.05 | 25.84 | 24.76 | 32.78 | 28 | 27.16 | 28.18 | |
| Gemini-32026.05 | 23.35 | 18.17 | 25.19 | 22.85 | 20.74 | 21.74 | |
| Lingshunumber of parameters=32B2026.05 | 22.34 | 12.03 | 22.62 | 14.13 | 16.29 | 16.27 | |
| HuluMednumber of parameters=32B2026.05 | 21.89 | 18.19 | 24.57 | 17.11 | 21.35 | 20.24 | |
| Qwen3-VLnumber of parameters=8B2026.05 | 21.4 | 14.52 | 20.25 | 16.67 | 17.67 | 17.28 | |
| HuluMednumber of parameters=14B2026.05 | 20.82 | 15.46 | 21.44 | 14.9 | 16.12 | 16.98 | |
| HuluMednumber of parameters=7B2026.05 | 20.18 | 13.64 | 18.43 | 11.67 | 12.84 | 14.15 | |
| M3D2026.05 | 19.46 | 12.62 | 19.14 | 10.08 | 11.39 | 13.31 | |
| RadFM2026.05 | 19.2 | 11.87 | 14.39 | 9.1 | 10.4 | 11.44 | |
| Lingshunumber of parameters=7B2026.05 | 17.51 | 8.86 | 10.38 | 6.99 | 6.26 | 8.12 | |
| MedGemmanumber of parameters=27B2026.05 | 16.36 | 3.86 | 8.59 | 4.73 | 4.91 | 5.52 | |
| MedGemmanumber of parameters=4B2026.05 | 14.43 | 3.11 | 5.8 | 3.4 | 3.17 | 3.87 |