Multiple Choice Question Answering on PathMMU (val)
80.1Overall AccuracyPathoSage
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| PathoSageHost Model=GPT-5.4, Evaluation Setting=Pass@42026.05 | 80.1 | 82.5 | 78.8 | 71.9 | 86.3 | 76 | |
| Gemini-3-Pro-Preview2026.05 | 74.5 | 80 | 69.2 | 72.9 | 81.5 | 66.7 | |
| PathoSageHost Model=GPT-5.4, Evaluation Setting=Pass@12026.05 | 74 | 75 | 69.9 | 65.6 | 80.7 | 72.7 | |
| Gemini-3-Flash-Preview2026.05 | 73.2 | 81.3 | 74.7 | 67.7 | 75.5 | 67.3 | |
| GPT-5.42026.05 | 65.4 | 70 | 58.9 | 58.3 | 71.2 | 64.7 | |
| Patho-R12026.05 | 63 | 82.5 | 63 | 41.7 | 64 | 64.7 | |
| Patho-R1-7BModel scale=Large, Thinking ability=With thinking ability2025.05 | 62.98 | 82.5 | 63.01 | 41.67 | 63.95 | 64.67 | |
| GPT-5.4-mini2026.05 | 61.8 | 70 | 56.9 | 46.9 | 68.2 | 62 | |
| Qwen3-VL-InstructScale=32B2026.05 | 59.7 | 71.2 | 61.6 | 40.6 | 61.4 | 61.3 | |
| Patho-R1-3BModel scale=Small, Thinking ability=With thinking ability2025.05 | 58.44 | 71.25 | 60.27 | 33.33 | 62.66 | 59.33 | |
| PathGen-LLaVA2026.05 | 58.2 | 67.5 | 61 | 50 | 59.7 | 53.3 | |
| PathGen-LLaVA-13BModel scale=Large, Thinking ability=Without thinking ability2025.05 | 58.16 | 67.5 | 60.96 | 50 | 59.66 | 53.33 | |
| HuatuoGPT-Vision-7BModel scale=Large, Thinking ability=Without thinking ability2025.05 | 54.61 | 61.25 | 54.11 | 38.54 | 55.36 | 60.67 | |
| HuatuoGPT2026.05 | 54.6 | 61.3 | 54.1 | 38.5 | 55.4 | 60.7 | |
| PathNavigateModel Category=Training-Free Pathology Agents2026.05 | 53.6 | — | — | — | — | — | |
| Qwen3-VL-InstructScale=8B2026.05 | 53.5 | 57.5 | 54.1 | 43.8 | 53.6 | 56.7 | |
| PathAgentModel Category=Training-Free Pathology Agents2026.05 | 52.84 | — | — | — | — | — | |
| MedGemma-1.5-4BModel Category=Supervised Pathology Models, Parameters=1.5-4B2026.05 | 50.62 | — | — | — | — | — | |
| InternVL3Scale=8B2026.05 | 49.8 | 52.5 | 45.9 | 40.6 | 52.4 | 54 | |
| InternVL3-8BModel scale=Large, Thinking ability=With thinking ability2025.05 | 49.79 | 52.5 | 45.89 | 40.63 | 52.36 | 54 | |
| InternVL2.5-8BModel scale=Large, Thinking ability=With thinking ability2025.05 | 47.8 | 46.25 | 52.05 | 33.33 | 47.64 | 54 | |
| InternVL2.5Scale=8B2026.05 | 47.8 | 46.3 | 52.1 | 33.3 | 47.6 | 54 | |
| Qwen3.5-9BModel Category=Pretrained MLLM Models, Parameters=9B2026.05 | 45.84 | — | — | — | — | — | |
| Llama-3.2V-11B-cotModel scale=Large, Thinking ability=With thinking ability2025.05 | 45.82 | 46.25 | 42.47 | 35.42 | 47.64 | 52.67 | |
| Qwen2.5VL-3BModel scale=Small, Thinking ability=With thinking ability2025.05 | 45.67 | 52.5 | 45.89 | 28.13 | 51.07 | 44.67 | |
| Patho-R1 onlyModel Category=Supervised Pathology Models2026.05 | 42.18 | — | — | — | — | — | |
| InternVL2-8BModel scale=Large, Thinking ability=With thinking ability2025.05 | 40.28 | 41.25 | 41.1 | 23.96 | 42.92 | 45.33 | |
| Qwen2.5VL-7BModel scale=Large, Thinking ability=With thinking ability2025.05 | 38.44 | 43.75 | 34.93 | 29.17 | 39.91 | 42.67 | |
| Qwen3.5-4BModel Category=Pretrained MLLM Models, Parameters=4B2026.05 | 38.16 | — | — | — | — | — | |
| Llama-3.2-11B-Vision-InstructModel scale=Large, Thinking ability=With thinking ability2025.05 | 37.45 | 46.25 | 36.3 | 32.29 | 36.05 | 39.33 | |
| SlideChatModel Category=Supervised Pathology Models2026.05 | 37.42 | — | — | — | — | — | |
| WSI-LLaVAModel Category=Supervised Pathology Models2026.05 | 36.18 | — | — | — | — | — | |
| Quilt-LLaVA2026.05 | 33.1 | 45 | 32.9 | 17.7 | 34.3 | 34.7 | |
| Quilt-LLaVA-v1.5-7BModel scale=Large, Thinking ability=Without thinking ability2025.05 | 33.05 | 45 | 32.88 | 17.71 | 34.33 | 34.67 | |
| TITANModel Category=Supervised Pathology Models2026.05 | 32.18 | — | — | — | — | — | |
| DeepSeek-VL2-TinyModel scale=Small, Thinking ability=With thinking ability2025.05 | 29.08 | 36.25 | 28.77 | 17.71 | 28.33 | 34 | |
| VILA1.5-3BModel scale=Small, Thinking ability=Without thinking ability2025.05 | 27.23 | 22.5 | 27.4 | 16.67 | 31.33 | 30 | |
| Quilt-LLaVAModel Category=Supervised Pathology Models2026.05 | 26.5 | — | — | — | — | — | |
| Llama3.2-3B-vlModel scale=Small, Thinking ability=Without thinking ability2025.05 | 25.25 | 36.25 | 26.03 | 7.29 | 27.9 | 26 | |
| Random choice2026.05 | 25 | — | — | — | — | — | |
| LLaVA-Onevision-7BModel scale=Large, Thinking ability=With thinking ability2025.05 | 23.4 | 20 | 19.18 | 16.67 | 30.04 | 23.33 | |
| LLaVA-OnevisionScale=7B2026.05 | 23.4 | 20 | 19.2 | 16.7 | 30 | 23.3 | |
| LLaVA-Med2026.05 | 17.9 | 22.5 | 20.6 | 7.3 | 18.9 | 18 | |
| LLaVA-Med-v1.5-Mistral-7BModel scale=Large, Thinking ability=Without thinking ability2025.05 | 17.87 | 22.5 | 20.55 | 7.29 | 18.88 | 18 | |
| Paligemma2-3b-pt-224Model scale=Small, Thinking ability=Without thinking ability2025.05 | 1.28 | 1.25 | 1.37 | 0 | 2.15 | 0.67 |