Pathological Multimodal Understanding on PathMMU Tiny (test)
74.5PubMed ScoreGemini-1.5 Pro
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Gemini-1.5 ProUnif. Model=-2025.12 | 74.5 | 69 | 72.3 | 72.4 | 66.8 | 53.9 | |
| CPath-OmniUnif. Model=✘2025.12 | 74 | — | — | 69.8 | 65.9 | 75.7 | |
| UniPathUnif. Model=✔2025.12 | 72.9 | 68.3 | 67.9 | 70.1 | 79.2 | 46.1 | |
| Qwen2-VL-72B-InstructUnif. Model=✘2025.12 | 64.4 | 57.6 | 67.6 | 58 | 56.3 | 35.6 | |
| BAGEL-14BUnif. Model=✔2025.12 | 63 | 57.3 | 61.4 | 60.8 | 64.4 | 29.9 | |
| GPT-4V-1106Unif. Model=-2025.12 | 59.7 | 53.8 | 58.5 | 60.6 | 47.6 | 36.6 | |
| PathGen-LLaVAUnif. Model=✘2025.12 | 59.3 | 59.8 | 60.2 | 60.1 | 64.3 | 54.4 | |
| Qwen2-VL-7B-InstructUnif. Model=✘2025.12 | 59.1 | 54.9 | 63.3 | 56.1 | 52.4 | 39.5 | |
| UniMedVLUnif. Model=✔2025.12 | 58 | 54.5 | 57.1 | 55.7 | 66.3 | 30.5 | |
| Quilt-LLaVAUnif. Model=✘2025.12 | 46.8 | 45.4 | 46.3 | 51 | 46.5 | 32.8 | |
| LLaVA-1.5-13BUnif. Model=✘2025.12 | 45.2 | 39.1 | 39.6 | 35 | 46.5 | 25.9 | |
| Show-o-7BUnif. Model=✔2025.12 | 43.7 | 40.8 | 43.8 | 42.4 | 42.8 | 28.2 | |
| BLIP3-8BUnif. Model=✔2025.12 | 40.5 | 40 | 42.6 | 47.5 | 40.7 | 24.7 | |
| LLaVA-OneVision-7BUnif. Model=✘2025.12 | 38.2 | 36.8 | 34.9 | 46.4 | 39.6 | 20 | |
| LLaVA-MedUnif. Model=✘2025.12 | 29.2 | 25.5 | 29.8 | 23.3 | 21.7 | 22 |