Visual Question Answering on OphIn-VQA (Yes/No, What, Where scores)
97.33Yes/No Accuracy (LLM)OphIn-VL
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| OphIn-VLCategory=Ours2026.05 | 97.33 | 90.04 | 54.71 | 82.22 | 53.75 | 79.61 | 70 | 84.37 | |
| LLaVAMedCategory=General Medical MLLMs2026.05 | 95.33 | 99.51 | 25.44 | 74.29 | 29.5 | 76.99 | 52.03 | 84.22 | |
| OphthaReason-QwenCategory=Domain-specific MLLMs2026.05 | 73.11 | 97.2 | 25.39 | 76.48 | 34.16 | 73.14 | 45.16 | 83.13 | |
| InternVLCategory=General MLLMs2026.05 | 70.28 | 87.94 | 34.76 | 75 | 39.34 | 73.01 | 49.25 | 79.17 | |
| LingshuCategory=General Medical MLLMs2026.05 | 68.44 | 96.52 | 34.75 | 77.18 | 39.34 | 76.67 | 48.28 | 84.09 | |
| RetinalGPTCategory=Domain-specific MLLMs2026.05 | 61.44 | 95.67 | 10.64 | 73.03 | 25.15 | 73.67 | 33.08 | 81.36 | |
| LLaMACategory=General MLLMs2026.05 | 59.67 | 91.13 | 26.22 | 74.1 | 34.08 | 67.74 | 40.54 | 78.59 | |
| OphthaReason-InternVLCategory=Domain-specific MLLMs2026.05 | 50.89 | 90.72 | 23.28 | 75.17 | 31.38 | 73.67 | 35.53 | 80.44 | |
| Qwen3.5-9BCategory=General MLLMs2026.05 | 48.78 | 71.72 | 35.86 | 69.6 | 49.32 | 70.68 | 44.21 | 70.66 | |
| MedGemmaCategory=General Medical MLLMs2026.05 | 48.67 | 94.66 | 27.11 | 75.64 | 34.76 | 75.59 | 37.03 | 82.57 | |
| MedVLM-R1Category=General Medical MLLMs2026.05 | 17.11 | 90.79 | 25.38 | 70.97 | 32.43 | 75.74 | 24.27 | 79.48 | |
| FundusExpertsCategory=Domain-specific MLLMs2026.05 | 4.22 | 90.05 | 25.83 | 71.96 | 38.74 | 75.51 | 21.43 | 79.49 |