Multi-modal Question Answering on MMMU Health & Medicine
0.694AccuracyPulseMind-72B
Evaluation results
| Method | Links | |
|---|---|---|
| PulseMind-72BModel Category=Open-source, Model Scale=~72B2026.01 | 0.694 | |
| InternVL3-78BModel Category=Open-source, Model Scale=~72B2026.01 | 0.691 | |
| Qwen2.5VL-72BModel Category=Open-source, Model Scale=~72B2026.01 | 0.664 | |
| InternVL3-38BModel Category=Open-source, Model Scale=~32B2026.01 | 0.652 | |
| PulseMind-32BModel Category=Open-source, Model Scale=~32B2026.01 | 0.646 | |
| Qwen2.5VL-32BModel Category=Open-source, Model Scale=~32B2026.01 | 0.628 | |
| Lingshu-32BModel Category=Open-source, Model Scale=~32B2026.01 | 0.623 | |
| o1Model Category=Proprietary2026.01 | 0.578 | |
| GPT-4oModel Category=Proprietary2026.01 | 0.573 | |
| HuatuoGPT-vision-34BModel Category=Open-source, Model Scale=~32B2026.01 | 0.543 | |
| Gemini2.5-proModel Category=Proprietary2026.01 | 0.493 | |
| LLAVA-med-34BModel Category=Open-source, Model Scale=~32B2026.01 | 0.489 |