List your company
ResearchFormerly WizWand

Knowledge-based VQA on E-VQA

70.27Single-Hop AccuracyMG2-RAG
9.565225.325141.08556.8449Apr 4, 2026
Updated 6mo ago

Evaluation results

MethodLinks
MG2-RAGModel Category=Graph Retrieval-Augmented Models, LLM/MLLM=Qwen3.5-27B, Retrieval Pool Size=5k2026.0470.2760.24
MG2-RAGModel Category=Graph Retrieval-Augmented Models, LLM/MLLM=GPT-5.22026.0468.9660.3
MG2-RAGModel Category=Graph Retrieval-Augmented Models, LLM/MLLM=Qwen2.5-VL-7B, Retrieval Pool Size=5k2026.0462.8853.36
MG2-RAGModel Category=Graph Retrieval-Augmented Models, LLM/MLLM=Qwen3.5-27B2026.0461.6552.19
MG2-RAGModel Category=Graph Retrieval-Augmented Models, LLM/MLLM=Qwen2.5-VL-7B2026.0457.3348.59
MG2-RAGModel Category=Graph Retrieval-Augmented Models, LLM/MLLM=LLaMA-3.1-8B2026.0455.5747.77
EchoSightModel Category=Retrieval-Augmented Models, LLM/MLLM=LLaMA-3.1-8B, Modality=V→T2026.0452.9647.23
EchoSightModel Category=Retrieval-Augmented Models, LLM/MLLM=LLaMA-3.1-8B, Modality=V→V2026.0446.3241.29
GPT-5.2Model Category=Zero-Shot MLLMs, LLM/MLLM=GPT-5.22026.0444.1940.3
Qwen3.5-27BModel Category=Zero-Shot MLLMs, LLM/MLLM=Qwen3.5-27B2026.0429.7925.72
Gemini-3.1-ProModel Category=Zero-Shot MLLMs, LLM/MLLM=Gemini-3.1-Pro2026.0429.3627.9
Qwen2.5-VL-7BModel Category=Zero-Shot MLLMs, LLM/MLLM=Qwen2.5-VL-7B2026.0423.623.2
MMGraphRAG (5k)Model Category=Graph Retrieval-Augmented Models, LLM/MLLM=Qwen2.5-VL-7B, Retrieval Pool Size=5k2026.0419.1216.52
VaLiK (5k)Model Category=Graph Retrieval-Augmented Models, LLM/MLLM=Qwen2.5-VL-7B, Retrieval Pool Size=5k2026.0416.1615.22
LLaVA-v1.5Model Category=Zero-Shot MLLMs, LLM/MLLM=LLaMA-3.1-8B2026.041616.9
InstructBLIPModel Category=Zero-Shot MLLMs, LLM/MLLM=Flan-T5XL2026.0411.912