Closed-QA on Heartcare-BenchI
87.85Diagnosis AccuracyHeartcareGPT-3.8B
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| HeartcareGPT-3.8BModel Type=Medical Models2025.06 | 87.85 | 92.21 | 79.25 | 67.8 | 83.33 | |
| HeartcareGPT-7BModel Type=Medical Models2025.06 | 62.71 | 87.82 | 85.13 | 78.59 | 83.42 | |
| Yi-VL-6BModel Type=Generalist Models2025.06 | 59.55 | 44.46 | 17.06 | 39.85 | 39.97 | |
| Lingshu-7BModel Type=Medical Models2025.06 | 47.96 | 37.98 | 19.31 | 30.28 | 32.41 | |
| GPT5Model Type=Generalist Models2025.06 | 41.42 | 34.14 | 33.73 | 26.23 | 28.3 | |
| Gemma-3-4BModel Type=Generalist Models2025.06 | 38.73 | 38.09 | 20.63 | 19.32 | 25.59 | |
| Qwen2.5-VL-7BModel Type=Generalist Models2025.06 | 35.84 | 31.06 | 22.35 | 41.41 | 32.67 | |
| Claude-3.5Model Type=Generalist Models2025.06 | 30.58 | 37.76 | 37.83 | 34.45 | 31.23 | |
| InternVL-2.5-8BModel Type=Generalist Models2025.06 | 25.86 | 17.89 | 38.23 | 40.05 | 32.26 | |
| LLaVA-Med-7BModel Type=Medical Models2025.06 | 25.11 | 25.96 | 26.17 | 33.36 | 27.75 | |
| MiniCPM-V2.6-8BModel Type=Generalist Models2025.06 | 23.71 | 33.59 | 10.05 | 30.63 | 27.17 | |
| HealthGPT-M3-3.8BModel Type=Medical Models2025.06 | 15.35 | 12.41 | 16.06 | 23.97 | 18.39 | |
| LLaVA-1.5-7BModel Type=Generalist Models2025.06 | 15.15 | 12.4 | 18.2 | 25.47 | 21.08 | |
| MedVLM-R1-2BModel Type=Medical Models2025.06 | 14.08 | 19.43 | 8.33 | 35.56 | 20.09 |