Knowledge-Intensive Visual Question Answering on E-VQA (test)
52.6Accuracy (All)ProMSA
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ProMSARetriever=BGE+EVA-CLIP, Model=Qwen3-VL-8B, Category=Retrieval-Augmented Models2026.06 | 52.6 | 52.2 | — | — | |
| ProMSARetriever=BGE+EVA-CLIP, Model=Qwen2.5-VL-7B, Category=Retrieval-Augmented Models2026.06 | 49.7 | 50 | — | — | |
| REALRetriever=EVA-CLIP-8B, Model=Qwen3-VL-8B2026.02 | 41.4 | 45.5 | — | — | |
| REALRetriever=EVA-CLIP-8B, Model=Qwen3-VL-8B, Category=Retrieval-Augmented Models2026.06 | 41.4 | 45.5 | — | — | |
| MaS-VQARetriever=EVA-CLIP-8B, Model=Qwen3-VL-8B, Category=Retrieval-Augmented Models2026.06 | 41.3 | 42.2 | — | — | |
| ProMSARetriever=BGE+EVA-CLIP, Model=Qwen3-VL-2B, Category=Retrieval-Augmented Models2026.06 | 41.2 | 42.4 | — | — | |
| MMSearch-R1*Retriever=BGE+EVA-CLIP, Model=Qwen2.5-VL-7B, Category=Search-Agent Models2026.06 | 40.7 | 40.6 | — | — | |
| DeepEyesV2*Retriever=BGE+EVA-CLIP, Model=Qwen2.5-VL-7B, Category=Search-Agent Models2026.06 | 39.5 | 40.1 | — | — | |
| VLM-PRFRetriever=EVA-CLIP-8B, Model=InternVL3-8B2026.02 | 39.2 | 40.1 | — | — | |
| REALRetriever=EVA-CLIP-8B, Model=InternVL3.5-8B2026.02 | 39.2 | 43.9 | — | — | |
| Qwen3-VL-8B + LoTBackbone=Qwen3-VL-8B, Model Scale=Medium, Method=LoT2026.04 | 36.4 | 38.6 | — | — | |
| mKG-RAGRetriever=CLIP-ViT-L, Model=LLaMA3-8B2026.02 | 36.3 | 38.4 | — | — | |
| CC-VQARetriever=EVA-CLIP-8B, Model=Qwen2.5-VL-7B, Category=Retrieval-Augmented Models2026.06 | 36.1 | 41.4 | — | — | |
| Qwen2.5-VL-32B + LoTBackbone=Qwen2.5-VL-32B, Model Scale=Large, Method=LoT2026.04 | 36 | 37.7 | — | — | |
| ReflectiVARetriever=EVA-CLIP-8B, Model=LLaMA3.1-8B2026.02 | 35.5 | 35.5 | — | — | |
| VLM-PRFRetriever=EVA-CLIP-8B, Model=LLaMA3.1-8B2026.02 | 35.5 | 36.3 | — | — | |
| REALRetriever=EVA-CLIP-8B, Model=Qwen3-VL-2B2026.02 | 35.4 | 40 | — | — | |
| EchoSight†Retriever=EVA-CLIP-8B, Model=Qwen3-VL-8B, Category=Retrieval-Augmented Models2026.06 | 35.2 | 38.1 | — | — | |
| Qwen3-VL-8BBackbone=Qwen3-VL-8B, Model Scale=Medium, Method=Zero-shot retrieval-augmented2026.04 | 35 | 36.6 | — | — | |
| Qwen3-VL-4B + LoTBackbone=Qwen3-VL-4B, Model Scale=Small, Method=LoT2026.04 | 34.8 | 37.3 | — | — | |
| Qwen2.5-VL-32BBackbone=Qwen2.5-VL-32B, Model Scale=Large, Method=Zero-shot retrieval-augmented2026.04 | 33.7 | 35.3 | — | — | |
| InternVL3.5-38B + LoTBackbone=InternVL3.5-38B, Model Scale=Large, Method=LoT2026.04 | 33.5 | 35.8 | — | — | |
| Qwen3-VL-4BBackbone=Qwen3-VL-4B, Model Scale=Small, Method=Zero-shot retrieval-augmented2026.04 | 32.8 | 35 | — | — | |
| InternVL3.5-38BBackbone=InternVL3.5-38B, Model Scale=Large, Method=Zero-shot retrieval-augmented2026.04 | 31.6 | 33.8 | — | — | |
| Qwen2.5-VL-7B + LoTBackbone=Qwen2.5-VL-7B, Model Scale=Medium, Method=LoT2026.04 | 31.4 | 33.6 | — | — | |
| REALRetriever=EVA-CLIP-8B, Model=LLaVA-1.5-7B2026.02 | 30.9 | 33.5 | — | — | |
| InternVL3.5-8B + LoTBackbone=InternVL3.5-8B, Model Scale=Medium, Method=LoT2026.04 | 30.7 | 33.2 | — | — | |
| Qwen2.5-VL-3B + LoTBackbone=Qwen2.5-VL-3B, Model Scale=Small, Method=LoT2026.04 | 30.4 | 32.9 | — | — | |
| Qwen2.5-VL-7BBackbone=Qwen2.5-VL-7B, Model Scale=Medium, Method=Zero-shot retrieval-augmented2026.04 | 30.1 | 32.1 | — | — | |
| InternVL3.5-8BBackbone=InternVL3.5-8B, Model Scale=Medium, Method=Zero-shot retrieval-augmented2026.04 | 29 | 31.4 | — | — | |
| InternVL3.5-4B + LoTBackbone=InternVL3.5-4B, Model Scale=Small, Method=LoT2026.04 | 28.7 | 31.7 | — | — | |
| EchoSightRetriever=EVA-CLIP-8B, Model=LLaVA-1.5-7B2026.02 | 28.5 | 31.1 | — | — | |
| GPT-4VRetriever=None, Model=None, Category=Zero-shot MLLMs2026.06 | 28.1 | 26.9 | — | — | |
| Qwen2.5-VL-3BBackbone=Qwen2.5-VL-3B, Model Scale=Small, Method=Zero-shot retrieval-augmented2026.04 | 27.8 | 30.1 | — | — | |
| Wiki-LLAVARetriever=CLIP-ViT-L, Model=LLaVA-1.5-7B2026.02 | 27.1 | 25.7 | — | — | |
| InternVL3.5-4BBackbone=InternVL3.5-4B, Model Scale=Small, Method=Zero-shot retrieval-augmented2026.04 | 26.2 | 29.1 | — | — | |
| Qwen2-VL-7B + LoTBackbone=Qwen2-VL-7B, Model Scale=Medium, Method=LoT2026.04 | 25.6 | 28.7 | — | — | |
| EchoSightRetriever=EVA-CLIP-8B, Model=Mistral-7B, Category=Retrieval-Augmented Models2026.06 | 24.9 | 26.4 | — | — | |
| Qwen3-VL-8BRetriever=None, Model=None, Category=Zero-shot MLLMs2026.06 | 24.8 | 25.3 | — | — | |
| NoteMRRetriever=EVA-CLIP-8B, Model=Qwen3-VL-8B2026.02 | 23.6 | 25.6 | — | — | |
| Qwen2-VL-7BBackbone=Qwen2-VL-7B, Model Scale=Medium, Method=Zero-shot retrieval-augmented2026.04 | 22.9 | 25.6 | — | — | |
| Qwen3-VL-2BRetriever=None, Model=None, Category=Zero-shot MLLMs2026.06 | 21.9 | 22.2 | — | — | |
| Qwen2.5-VL-7BRetriever=None, Model=None, Category=Zero-shot MLLMs2026.06 | 20.6 | 22.1 | — | — | |
| RORA-VLMRetriever=CLIP+Google Search, Model=LLaVA-1.5-7B2026.02 | 20.3 | — | — | — | |
| Qwen2-VL-2B + LoTBackbone=Qwen2-VL-2B, Model Scale=Small, Method=LoT2026.04 | 16.2 | 18.2 | — | — | |
| Qwen2-VL-2BBackbone=Qwen2-VL-2B, Model Scale=Small, Method=Zero-shot retrieval-augmented2026.04 | 16 | 17.5 | — | — | |
| BLIP-2Retriever=None, Model=Flan-T5, Category=Zero-shot MLLMs2026.06 | 12.4 | 12.6 | — | — | |
| PromptCapRetriever=EVA-CLIP-8B, Model=Flan-T5-11B2026.02 | 11.4 | 10.8 | — | — | |
| Prophet++Retriever=EVA-CLIP-8B, Model=Qwen3-VL-8B2026.02 | 11.4 | 10.8 | — | — | |
| BLIP-2Model=Flan-T5XL, Retrieval Mode=-, Category=Zero-shot MLLMs2026.02 | — | — | 12.6 | 12.4 | |
| DPR V+TModel=Multi-passage BERT, Retrieval Mode=CLIP ViT-B/32, Category=Retrieval-Augmented Models2026.02 | — | — | 29.1 | — | |
| EchoSightModel=Mistral-7B/LLaMA-3-8B, Retrieval Mode=EVA-CLIP-8B, Category=Retrieval-Augmented Models2026.02 | — | — | 19.4 | — | |
| GPT-4VModel=GPT-4V, Retrieval Mode=-, Category=Zero-shot MLLMs2026.02 | — | — | 26.9 | 28.1 | |
| InternVL3-8BModel=InternVL3-8B, Retrieval Mode=-, Category=Zero-shot MLLMs2026.02 | — | — | 15.7 | 15.9 | |
| MaS-VQAModel=InternVL3-8B, Retrieval Mode=EVA-CLIP-8B, Category=Retrieval-Augmented Models2026.02 | — | — | 40.8 | 40.1 | |
| MaS-VQAModel=Qwen3-VL-8B, Retrieval Mode=EVA-CLIP-8B, Category=Retrieval-Augmented Models2026.02 | — | — | 42.2 | 41.3 | |
| MMKB-RAGModel=Qwen2-7B, Retrieval Mode=EVA-CLIP-8B, Category=Retrieval-Augmented Models2026.02 | — | — | 39.7 | 35.9 | |
| NoteMRModel=Qwen3-VL-8B, Retrieval Mode=EVA-CLIP-8B, Category=Retrieval-Augmented Models2026.02 | — | — | 25.6 | 23.6 | |
| Prophet++Model=Qwen3-VL-8B, Retrieval Mode=EVA-CLIP-8B, Category=Retrieval-Augmented Models2026.02 | — | — | 22.5 | 20 | |
| Qwen2.5-VL-7BModel=Qwen2.5-VL-7B, Retrieval Mode=-, Category=Zero-shot MLLMs2026.02 | — | — | 16.3 | 16.3 | |
| Qwen3-VL-8BModel=Qwen3-VL-8B, Retrieval Mode=-, Category=Zero-shot MLLMs2026.02 | — | — | 19.5 | 19.5 | |
| ReflectiVAModel=LLaMA-3.1-8B, Retrieval Mode=EVA-CLIP-8B, Category=Retrieval-Augmented Models2026.02 | — | — | 28 | 29.2 | |
| VLM-PRFModel=InternVL3-8B, Retrieval Mode=EVA-CLIP-8B, Category=Retrieval-Augmented Models2026.02 | — | — | 40.1 | 39.2 | |
| Wiki-LLaVAModel=Vicuna-7B, Retrieval Mode=CLIP ViT-L/14+Contriever, Category=Retrieval-Augmented Models2026.02 | — | — | 17.7 | 20.3 |