List your company
ResearchFormerly WizWand

Visual Question Answering on GQA v1.0 (test)

63.3AccuracyShareGPT4V
45.41250.05654.759.344Sep 29, 2025Oct 28, 2025Nov 26, 2025Dec 25, 2025Jan 23, 2026Feb 21, 2026Mar 22, 2026
Updated 7mo ago

Evaluation results

MethodLinks
ShareGPT4VLLM=Vicuna-7B, #Samples=1.9M2026.0363.3
MobileVLM V2 7BLLM=Vicuna-7B, #Samples=3.6M2026.0362.6
LLaVA-1.5LLM=Vicuna-7B, #Samples=1.2M2026.0362
LLaVA-1.5-7BBackbone=LLaVA-1.5-7B, Retained Tokens=5762025.0961.9
MoE-LLaVA-2BLLM=Qwen-1.5-1.8B, #Samples=2.2M2026.0361.5
Cosine KD w/ Beta-KD (Instance)LLM=MobileLLaMA 1.4B, #Samples=3.6M2026.0361.2
Align-KD w/ Beta-KD (Instance)LLM=MobileLLaMA 1.4B, #Samples=3.6M2026.0360.8
Cosine KD w/ Beta-KD (Task)LLM=MobileLLaMA 1.4B, #Samples=3.6M2026.0360.8
MoE-LLaVA-1.6BLLM=StableLM-1.6B, #Samples=2.2M2026.0360.4
Align-KD w/ Beta-KD (Task)LLM=MobileLLaMA 1.4B, #Samples=3.6M2026.0360.2
ZOO-PruneBackbone=LLaVA-1.5-7B, Retained Tokens=1922025.0960.03
Align-KDLLM=MobileLLaMA 1.4B, #Samples=3.6M2026.0360
DivPruneBackbone=LLaVA-1.5-7B, Retained Tokens=1922025.0959.97
Cosine KDLLM=MobileLLaMA 1.4B, #Samples=3.6M2026.0359.9
ZOO-PruneBackbone=LLaVA-1.5-7B, Retained Tokens=1282025.0959.49
VisionZipBackbone=LLaVA-1.5-7B, Retained Tokens=1922025.0959.3
DivPruneBackbone=LLaVA-1.5-7B, Retained Tokens=1282025.0959.25
MobileVLM 3BLLM=MobileLLaMA 2.7B, #Samples=3.6M2026.0359
ZOO-PruneBackbone=LLaVA-1.5-7B, Retained Tokens=642025.0958.47
DivPruneBackbone=LLaVA-1.5-7B, Retained Tokens=642025.0957.78
SparseVLMBackbone=LLaVA-1.5-7B, Retained Tokens=1922025.0957.6
VisionZipBackbone=LLaVA-1.5-7B, Retained Tokens=1282025.0957.6
MobileVLM 1.7BLLM=MobileLLaMA 1.4B, #Samples=3.6M2026.0356.1
SparseVLMBackbone=LLaVA-1.5-7B, Retained Tokens=1282025.0956
LLAVADILLM=MobileLLaMA 1.4B, #Samples=3.6M2026.0355.4
VisionZipBackbone=LLaVA-1.5-7B, Retained Tokens=642025.0955.1
MobileVLM -V2 1.7BLLM=MobileLLaMA 1.4B, #Samples=3.6M2026.0355.1
FastVBackbone=LLaVA-1.5-7B, Retained Tokens=1922025.0952.7
SparseVLMBackbone=LLaVA-1.5-7B, Retained Tokens=642025.0952.7
FastVBackbone=LLaVA-1.5-7B, Retained Tokens=1282025.0949.6
FastVBackbone=LLaVA-1.5-7B, Retained Tokens=642025.0946.1