List your company
ResearchFormerly WizWand

Visual Question Answering on VQAv2 3K curated MS COCO (test)

7.4Relative Performance Drop (%)DLA
6.23614.09321.9529.807Apr 20, 2026
Updated 6mo ago

Evaluation results

MethodLinks
DLABase Model=LLaVA-1.5-7B, Masking Ratio=top-1%2026.047.4
DLABase Model=Qwen2.5-VL-7B, Masking Ratio=top-1%2026.049.8
LLM-KnowledgeBase Model=LLaVA-1.5-7B, Masking Ratio=top-1%2026.0416.5
Group PatchingBase Model=LLaVA-1.5-7B, Masking Ratio=top-1%2026.0418
LLM-KnowledgeBase Model=Qwen2.5-VL-7B, Masking Ratio=top-1%2026.0419.4
Group PatchingBase Model=Qwen2.5-VL-7B, Masking Ratio=top-1%2026.0420.05
QRNCABase Model=LLaVA-1.5-7B, Masking Ratio=top-1%2026.0420.8
QRNCABase Model=Qwen2.5-VL-7B, Masking Ratio=top-1%2026.0424.5
HONESBase Model=LLaVA-1.5-7B, Masking Ratio=top-1%2026.0427.3
HONESBase Model=Qwen2.5-VL-7B, Masking Ratio=top-1%2026.0436.5