List your company
ResearchFormerly WizWand

Visual Question Answering on ScienceQA (SQAI)

74.2AccuracyLLaVA-1.5 + MMInstruct
59.95263.65167.3571.049Mar 27, 2024Aug 12, 2024Dec 28, 2024May 16, 2025Oct 1, 2025Feb 16, 2026Jul 5, 2026
Updated 3mo ago

Evaluation results

MethodLinks
LLaVA-1.5 + MMInstructLLM=Vicuna-13B2024.0774.2
LLaVA-VTLLM=Vicuna-13B, #PT=558K, #IT=665K, Representation=E + T2024.0372.6
LLaVA-CapLLM=Vicuna-13B, #PT=558K, #IT=665K, Representation=E + T2024.0371.9
LLaVA-SGLLM=Vicuna-13B, #PT=558K, #IT=665K, Representation=E + T2024.0371.8
LLaVA-1.5 (V-13B)LLM=Vicuna-13B, #PT=558K, #IT=665K, Representation=Visual Embeddings (E)2024.0371.6
LLaVA-1.5LLM=Vicuna-13B2024.0771.6
LLaVA-DCapLLM=Vicuna-13B, #PT=558K, #IT=665K, Representation=E + T2024.0371.2
LLaVA-1.5 + MMInstructLLM=Vicuna-7B2024.0771.2
Vicuna-VTLLM=Vicuna-13B, #IT=665K, Representation=Text (T)2024.0370
Vicuna-CapLLM=Vicuna-13B, #IT=665K, Representation=Text (T)2024.0369.5
γ-MoD-LLaVA-HRParam.=13B, Speed=4.82024.1069.5
Vicuna-DCapLLM=Vicuna-13B, #IT=665K, Representation=Text (T)2024.0369.3
Vicuna-SGLLM=Vicuna-13B, #IT=665K, Representation=Text (T)2024.0368.9
MoE-LLaVAParam.=5B, Speed=5.62024.1068.5
LLaVA-SPLLM=Vicuna-7B, Resolution=3362026.0768.4
Qwen-VL-ChatLLM=Qwen-7B, #PT=1.4B, #IT=50M, Representation=Visual Embeddings (E)2024.0368.2
VILAParam.=7B2024.1068.2
Qwen-VL-chatLLM=Qwen-7B2024.0768.2
Qwen-VL-ChatLLM=Qwen-7B, Resolution=4482026.0768.2
LLaVA-HRParam.=13B, Speed=3.12024.1068.1
LLaVA-HRParam.=7B, Speed=4.72024.1067.9
γ-MoD-LLaVA-HRParam.=7B, Speed=7.22024.1067.9
LLaVA-1.5LLM=Vicuna-7B, Resolution=3362026.0767.6
Qwen-VLLLM=Qwen-7B, #PT=1.4B, #IT=50M, Representation=Visual Embeddings (E)2024.0367.1
Qwen-VLParam.=10B, Speed=4.62024.1067.1
Qwen-VLLLM=Qwen-7B2024.0767.1
Qwen-VLLLM=Qwen-7B, Resolution=4482026.0767.1
LLaVA-1.5 (V-7B)LLM=Vicuna-7B, #PT=558K, #IT=665K, Representation=Visual Embeddings (E)2024.0366.8
LLaVA-1.5Param.=7B, Speed=8.12024.1066.8
LLaVA-1.5LLM=Vicuna-7B2024.0766.8
LLaVA-1.5LLM=Vicuna-7B, Resolution=3362026.0766.8
γ-MoD-LLaVAParam.=7B, Speed=10.32024.1064.7
InstructBLIP (V-13B)LLM=Vicuna-13B, #PT=129M, #IT=1.2M, Representation=Visual Embeddings (E)2024.0363.1
InstructBLIPParam.=14B2024.1063.1
InstructBLIPLLM=Vicuna-13B2024.0763.1
MoE-LLaVAParam.=3B, Speed=8.52024.1062.6
TrustLLaVALLM=Vicuna-7B, Resolution=3362026.0762.1
BLIP-2LLM=Vicuna-13B, #PT=129M, Representation=Visual Embeddings (E)2024.0361
BLIP-2LLM=Vicuna-13B2024.0761
InstructBLIP (V-7B)LLM=Vicuna-7B, #PT=129M, #IT=1.2M, Representation=Visual Embeddings (E)2024.0360.5
InstructBLIPLLM=Vicuna-7B2024.0760.5
TrustLLaVA (MLP)LLM=Vicuna-7B, Resolution=3362026.0760.5