Visual Question Answering (Closed-ended) on PathVQA
95AccuracyCLAREoracle
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| CLAREoracleBackbone (Size)=Qwen2-vl (7B)2025.08 | 95 | — | — | — | |
| CLAREoracleBackbone (Size)=Pixtral (12B)2025.08 | 95 | — | — | — | |
| MEDSIGHTFine-tuning protocol=LoRA, LoRA rank=322026.06 | 94.2 | — | — | — | |
| HuatuoGPT-Vision 7BFine-tuning protocol=LoRA, LoRA rank=322026.06 | 93.3 | — | — | — | |
| ExGra-MedFine-tuning protocol=LoRA, LoRA rank=322026.06 | 93.3 | — | — | — | |
| LLaVA-Med 1.5Fine-tuning protocol=LoRA, LoRA rank=322026.06 | 93.2 | — | — | — | |
| CLAREBackbone (Size)=Qwen2-vl (7B)2025.08 | 93 | — | — | — | |
| CLARE + PDistBackbone (Size)=Qwen2-vl (7B)2025.08 | 92 | — | — | — | |
| FT RAGBackbone (Size)=Qwen2-vl (7B)2025.08 | 91 | — | — | — | |
| MMed-RAGBackbone (Size)=LLaVA (7B)2025.08 | 90 | — | — | — | |
| CLAREBackbone (Size)=Pixtral (12B)2025.08 | 90 | — | — | — | |
| BiasCareVL2026.04 | 89.8 | 89.7 | 90.1 | 89.5 | |
| CLARE + PDistBackbone (Size)=Pixtral (12B)2025.08 | 89 | — | — | — | |
| BioMedGPTYear=20242026.04 | 88 | — | — | — | |
| MedPLIB-7BYear=2025, Parameters=7B2026.04 | 88 | 88 | 88 | 88.3 | |
| FT RAGBackbone (Size)=Pixtral (12B)2025.08 | 88 | — | — | — | |
| ReaderBackbone (Size)=Qwen2-vl (7B)2025.08 | 87 | — | — | — | |
| ReaderBackbone (Size)=Pixtral (12B)2025.08 | 87 | — | — | — | |
| HuaTuoGPT-Vision-34BYear=2024, Parameters=34B2026.04 | 58.2 | — | — | — | |
| HuaTuoGPT-Vision-7BYear=2024, Parameters=7B2026.04 | 56.4 | 55.7 | 65.1 | 54.2 | |
| Qwen-VL-ChatYear=20232026.04 | 55.1 | — | — | — | |
| Med-FlamingoYear=20232026.04 | 54.7 | — | — | — | |
| MIMOYear=20252026.04 | 52.4 | — | — | — | |
| DeepSeek-VL2-tinyYear=20252026.04 | 46.6 | 46.3 | 61.1 | 49 | |
| DeepSeek-VL2-smallYear=20252026.04 | 40 | 45.4 | 54 | 40.2 | |
| RadFMYear=20252026.04 | 38.7 | — | — | — | |
| Qwen-VL2.5-3B-InstructYear=2025, Parameters=3B2026.04 | 18 | 23.9 | 75 | 16.9 |