Medical Visual Question Answering on Med-R2 (test)
74.6Image Quality ACCJanus-Pro-7B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Janus-Pro-7BModel Category=Open Source, Zero-shot=true2026.05 | 74.6 | 51.3 | 49.5 | 32.7 | 52 | |
| Linshu-7BModel Category=Medical Specific, Zero-shot=true2026.05 | 67.3 | 56 | 41.6 | 60.2 | 56.3 | |
| GPT-5.2-thinkingModel Category=Proprietary, Zero-shot=true2026.05 | 63.7 | 65.6 | 49.9 | 90.2 | 67.4 | |
| Intern3-VL3-8BModel Category=Open Source, Zero-shot=true2026.05 | 58.3 | 61 | 54 | 73.8 | 61.8 | |
| Qwen3-VL-235bModel Category=Proprietary, Zero-shot=true2026.05 | 54.2 | 64.2 | 51.3 | 72.5 | 60.6 | |
| Qwen3-VL-8BModel Category=Open Source, Zero-shot=true2026.05 | 53.3 | 63.3 | 52 | 75.3 | 61 | |
| GPT-4oModel Category=Proprietary, Zero-shot=true2026.05 | 53 | 56.1 | 47 | 65.5 | 55.4 | |
| Qwen2.5-VL-7BModel Category=Open Source, Zero-shot=true2026.05 | 49.3 | 51.5 | 55.1 | 57.3 | 53.3 | |
| HuatuoGPT-Vision-34BModel Category=Medical Specific, Zero-shot=true2026.05 | 48 | 65.9 | 53.5 | 54.8 | 55.6 | |
| Hulu-Med-14BModel Category=Medical Specific, Zero-shot=true2026.05 | 47.4 | 68.1 | 68.6 | 63.1 | 61.8 | |
| HuatuoGPT-Vision-7BModel Category=Medical Specific, Zero-shot=true2026.05 | 41.9 | 58.7 | 50.5 | 51 | 50.5 | |
| Hulu-Med-4BModel Category=Medical Specific, Zero-shot=true2026.05 | 41.4 | 60.3 | 57.9 | 58.4 | 54.5 | |
| Hulu-Med-7BModel Category=Medical Specific, Zero-shot=true2026.05 | 36.5 | 60.7 | 58.8 | 48.9 | 51.2 | |
| Medgemma-4BModel Category=Medical Specific, Zero-shot=true2026.05 | 24.2 | 36.4 | 32.5 | 45.3 | 34.6 |