Closed-QA on Heartcare-BenchS
86.16Diagnosis ScoreHeartcareGPT-7B
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| HeartcareGPT-7BModel Type=Medical Models2025.06 | 86.16 | 98.62 | 93.2 | 75.15 | 83.42 | |
| HeartcareGPT-3.8BModel Type=Medical Models2025.06 | 81.95 | 95.94 | 82.79 | 79.84 | 83.33 | |
| Yi-VL-6BModel Type=Generalist Models2025.06 | 49.19 | 38.9 | 31.06 | 39.65 | 39.97 | |
| Claude-3.5Model Type=Generalist Models2025.06 | 37.37 | 20.73 | 15.96 | 35.16 | 31.23 | |
| MiniCPM-V2.6-8BModel Type=Generalist Models2025.06 | 32.37 | 31.34 | 23.4 | 32.23 | 27.17 | |
| InternVL-2.5-8BModel Type=Generalist Models2025.06 | 29.87 | 34.18 | 31.25 | 40.75 | 32.26 | |
| GPT5Model Type=Generalist Models2025.06 | 29.87 | 15.23 | 19.57 | 25.23 | 28.3 | |
| Lingshu-7BModel Type=Medical Models2025.06 | 29.56 | 33.44 | 40 | 20.75 | 32.41 | |
| Qwen2.5-VL-7BModel Type=Generalist Models2025.06 | 28.29 | 35.36 | 31.7 | 35.31 | 32.67 | |
| LLaVA-Med-7BModel Type=Medical Models2025.06 | 27.79 | 25.86 | 24.04 | 33.69 | 27.75 | |
| Gemma-3-4BModel Type=Generalist Models2025.06 | 23.84 | 24.36 | 18.3 | 21.47 | 25.59 | |
| HealthGPT-M3-3.8BModel Type=Medical Models2025.06 | 21.63 | 10.87 | 26.58 | 20.23 | 18.39 | |
| LLaVA-1.5-7BModel Type=Generalist Models2025.06 | 19.26 | 27.03 | 22.19 | 28.96 | 21.08 | |
| MedVLM-R1-2BModel Type=Medical Models2025.06 | 16.27 | 15.42 | 15.32 | 36.32 | 20.09 |