Visual Question Answering on VQAv2 3K curated MS COCO (test)
7.4Relative Performance Drop (%)DLA
Evaluation Results
| Method | Links | |
|---|---|---|
| DLABase Model=LLaVA-1.5-7B, Masking Ratio=top-1%2026.04 | 7.4 | |
| DLABase Model=Qwen2.5-VL-7B, Masking Ratio=top-1%2026.04 | 9.8 | |
| LLM-KnowledgeBase Model=LLaVA-1.5-7B, Masking Ratio=top-1%2026.04 | 16.5 | |
| Group PatchingBase Model=LLaVA-1.5-7B, Masking Ratio=top-1%2026.04 | 18 | |
| LLM-KnowledgeBase Model=Qwen2.5-VL-7B, Masking Ratio=top-1%2026.04 | 19.4 | |
| Group PatchingBase Model=Qwen2.5-VL-7B, Masking Ratio=top-1%2026.04 | 20.05 | |
| QRNCABase Model=LLaVA-1.5-7B, Masking Ratio=top-1%2026.04 | 20.8 | |
| QRNCABase Model=Qwen2.5-VL-7B, Masking Ratio=top-1%2026.04 | 24.5 | |
| HONESBase Model=LLaVA-1.5-7B, Masking Ratio=top-1%2026.04 | 27.3 | |
| HONESBase Model=Qwen2.5-VL-7B, Masking Ratio=top-1%2026.04 | 36.5 |