List your company
ResearchFormerly WizWand

Visual Question Answering on PMC-VQA (test)

64.9AccuracyLiteMedCoT-VL
-1.24415.92833.150.272May 25, 2025Jul 22, 2025Sep 18, 2025Nov 16, 2025Jan 13, 2026Mar 12, 2026May 10, 2026
Updated 5mo ago

Evaluation results

MethodLinks
LiteMedCoT-VL2026.0564.9
Qwen3-VL-4B2026.0553.9
Qwen3-VL-2B2026.0548.7
TMA-AllComponBase Model=Gemma-3-4B, Image Resolution=3-5x reduced2025.0845.3
SmolVLM2-2.2B2026.0541.5
Single-Agent BestBase Model=Gemma-3-4B, Image Resolution=3-5x reduced2025.0840
Phi-3.5-vision2026.0539.2
ReinPathParams=8B, Samples=22K2026.0138.6
SFTPathParams=8B, Samples=13K2026.0138.1
MedICaP-PMCVQA-GPT-42026.0535.9
ReConcileBase Model=Gemma-3-4B, Image Resolution=3-5x reduced2025.0835.3
LLaVA-1.5Params=13B, Samples=665K2026.0135.1
LLaVA-Med2026.0534.8
MedAgentsBase Model=Gemma-3-4B, Image Resolution=3-5x reduced2025.0834.7
DyLanBase Model=Gemma-3-4B, Image Resolution=3-5x reduced2025.0832.7
Quilt-LLaVAParams=7B, Samples=107K2026.0132.4
InternVL2-2B2026.0531.7
MDAgentsBase Model=Gemma-3-4B, Image Resolution=3-5x reduced2025.0831.3
MedICap-GPT-42026.0527.2
Open-Flamingo2026.0526.4
LLaVA-Med_{MedITok}Evaluation Protocol=free-form2025.0525.55
LLaVA-Med_{MedITok} w/o S1Evaluation Protocol=free-form2025.0524.74
PMC-CLIP2026.0524.7
BLIP-22026.0524.3
LLaVA-Med_{UniTok}Evaluation Protocol=free-form2025.0522.6
LLaVA-MedEvaluation Protocol=free-form2025.0521.55
LLaVA-MedParams=7B, Samples=60K2026.011.3