Medical Visual Question Answering on SLAKE (Open/Closed/Overall)
93.27Closed ScoreMUMC
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MUMCreported_format=Mean ± Standard Deviation2026.04 | 93.27 | 75.04 | 82.19 | |
| CLAREoracleBackbone=Qwen2-vl (7B)2025.08 | 92 | — | — | |
| CLAREoracleBackbone=Pixtral (12B)2025.08 | 92 | — | — | |
| DCI2026.04 | 91.3 | 86.8 | 88.6 | |
| M2I22026.04 | 91.1 | 74.7 | 81.2 | |
| CLAREBackbone=Qwen2-vl (7B)2025.08 | 90 | 84 | — | |
| CLAREBackbone=Pixtral (12B)2025.08 | 90 | 84 | — | |
| M2I2reported_format=Mean ± Standard Deviation2026.04 | 89.5 | 73.21 | 77.6 | |
| CIMB-MVQA2026.04 | 89.4 | 82.1 | 85.1 | |
| CLARE + PDistBackbone=Qwen2-vl (7B)2025.08 | 89 | 81 | — | |
| CLARE + PDistBackbone=Pixtral (12B)2025.08 | 89 | 81 | — | |
| FT RAGBackbone=Qwen2-vl (7B)2025.08 | 88 | 81 | — | |
| FT RAGBackbone=Pixtral (12B)2025.08 | 88 | 81 | — | |
| PMC-CLIP2026.04 | 88 | 81.9 | 84.3 | |
| MQATreported_format=Mean ± Standard Deviation2026.04 | 87.97 | 77.2 | 81.5 | |
| M3AE2026.04 | 87.8 | 80.3 | 83.3 | |
| M3AEreported_format=Mean ± Standard Deviation2026.04 | 87.65 | 80.78 | 83.47 | |
| KG-CMIreported_format=Mean ± Standard Deviation2026.04 | 87.47 | 82.78 | 84.26 | |
| LaPAreported_format=Mean ± Standard Deviation2026.04 | 87.25 | 80 | 82.84 | |
| MMed-RAGBackbone=LLaVA (7B)2025.08 | 87 | 81 | — | |
| DeCoCT2026.04 | 87 | 82.5 | 84.9 | |
| CCIS-MVQA*reported_format=Point estimate2026.04 | 86.72 | 80.12 | 84.08 | |
| CCIS-MVQA2026.04 | 86.7 | 80.1 | 84.1 | |
| UnICLAM*reported_format=Point estimate2026.04 | 85.7 | 81.1 | 83.1 | |
| VG-CALFreported_format=Mean ± Standard Deviation2026.04 | 84.23 | 81.64 | 83.43 | |
| ReaderBackbone=Qwen2-vl (7B)2025.08 | 84 | 80 | — | |
| CPRD-BAN2026.04 | 83.4 | 79.5 | 81.1 | |
| ReaderBackbone=Pixtral (12B)2025.08 | 83 | 80 | — | |
| PubMedCLIP2026.04 | 82.5 | 78.4 | 80.1 | |
| CLIP-ViT2026.04 | 82.1 | 84.3 | 83.3 | |
| MPRreported_format=Mean ± Standard Deviation2026.04 | 81.5 | 75.5 | 77.9 | |
| AMAM2026.04 | 80.3 | 63.8 | 73.3 | |
| MEVF-BAN2026.04 | 79.8 | 77.8 | 78.6 | |
| MUMC2026.04 | — | — | 84.9 |