List your company
ResearchFormerly WizWand

General Visual Question Answering on GQA

61.94AccuracyVanilla
25.040834.620444.253.7796May 1, 2026May 11, 2026May 21, 2026May 31, 2026Jun 10, 2026Jun 20, 2026Jun 30, 2026
Updated 4mo ago

Evaluation results

MethodLinks
VanillaBackbone=LLaVA-1.5-7B, TFLOPs=100%2026.0661.94
VSkip+Backbone=LLaVA-1.5-7B, TFLOPs=76%, N=202026.0661.63
VanillaBackbone=Qwen3-VL-8B, TFLOPs=100%2026.0661.6
APETBackbone=Qwen3-VL-8B, TFLOPs=66%2026.0660.96
Op-SkipBackbone=LLaVA-1.5-7B, TFLOPs=66%, N=202026.0660.84
VSkipBackbone=LLaVA-1.5-7B, TFLOPs=76%, N=202026.0660.77
Op-SkipBackbone=Qwen3-VL-8B, TFLOPs=66%, N=202026.0660.7
VSkipBackbone=Qwen3-VL-8B, TFLOPs=76%, N=202026.0660.67
ShortVBackbone=Qwen3-VL-8B, TFLOPs=58%, N=202026.0660.59
V2DropBackbone=LLaVA-1.5-7B, TFLOPs=66%2026.0660.51
ShortVBackbone=LLaVA-1.5-7B, TFLOPs=55%, N=202026.0660.49
APETBackbone=LLaVA-1.5-7B, TFLOPs=66%2026.0660.45
VanillaBackbone=Qwen2.5-VL-7B, TFLOPs=100%2026.0660.4
V2DropBackbone=Qwen3-VL-8B, TFLOPs=66%2026.0660.06
APETBackbone=Qwen2.5-VL-7B, TFLOPs=55%2026.0659.38
Op-SkipBackbone=Qwen2.5-VL-7B, TFLOPs=55%, N=202026.0659.29
V2DropBackbone=Qwen2.5-VL-7B, TFLOPs=55%2026.0658.87
AVLM-2BModel Scale=2B2026.0658.4
VSkipBackbone=Qwen2.5-VL-7B, TFLOPs=67%, N=162026.0657.26
VTWBackbone=LLaVA-1.5-7B, TFLOPs=55%, K=162026.0654.77
ShortVBackbone=Qwen2.5-VL-7B, TFLOPs=50%, N=202026.0649.47
VTWBackbone=Qwen2.5-VL-7B, TFLOPs=50%, K=162026.0646.01
GenLIPArch=g/16, Data=8.0B2026.0545.5
SigLIP2Arch=g/16, Data=40.0B2026.0545.2
GenLIPArch=So/16, Data=8.0B2026.0544
AIMv2Arch=L/14, Data=12.0B2026.0543.9
VTWBackbone=Qwen3-VL-8B, TFLOPs=58%, K=162026.0643.72
SigLIP2Arch=So/16, Data=40.0B2026.0543.5
OVision2Arch=L/16, Data=12.8B2026.0542.7
SigLIP2Arch=L/16, Data=40.0B2026.0542.6
SigLIPArch=L/16, Data=40.0B2026.0541.7
GenLIPArch=L/16, Data=8.0B2026.0541.5
CLIPArch=L/14, Data=12.8B2026.0539.8
Gemma-4-E2B-itModel Scale=4B2026.0639.51
Qwen2.5-Omni-3BModel Scale=3B2026.0626.46