List your company
ResearchFormerly WizWand

Visual Question Answering on VQA text

83.2AccuracyQ2.5VL-7B
42.6453.1763.774.23Mar 18, 2025May 14, 2025Jul 10, 2025Sep 5, 2025Nov 1, 2025Dec 28, 2025Feb 23, 2026
Updated 6mo ago

Evaluation results

MethodLinks
Q2.5VL-7BTokens Retained Percentage=100%2025.0383.2
TwigVLM++Tokens Retained Percentage=33.3%2025.0383.2
TwigVLMTokens Retained Percentage=33.3%2025.0382.6
TwigVLM++Tokens Retained Percentage=22.2%2025.0382.5
VanillaBackbone=QWEN-2.5-VL 7B, Average Tokens=100%2026.0282.2
FastVTokens Retained Percentage=33.3%2025.0381.5
TwigVLMTokens Retained Percentage=22.2%2025.0381.4
TwigVLM++Tokens Retained Percentage=11.1%2025.0379.5
FastVTokens Retained Percentage=22.2%2025.0379.2
NuwaBackbone=QWEN-2.5-VL 7B, Average Tokens=75%2026.0277.35
VisionZipTokens Retained Percentage=33.3%2025.0376.3
NuwaBackbone=QWEN-2.5-VL 7B, Average Tokens=50%2026.0276.03
NuwaBackbone=QWEN-2.5-VL 7B, Average Tokens=25%2026.0273.81
TwigVLMTokens Retained Percentage=11.1%2025.0373
VisionZipTokens Retained Percentage=22.2%2025.0371.6
FastVTokens Retained Percentage=11.1%2025.0362.9
VisionZipTokens Retained Percentage=11.1%2025.0358.7
LLaVA-1.5-7BRetained Tokens=5762025.0958.2
VanillaBase Model=LLaVA-1.5-7B, Retained Tokens=576, Reduction Rate=0%2026.0258.2
ZOO-PruneRetained Tokens=1282025.0957.87
VisionZipRetained Tokens=1922025.0957.3
ZOO-PruneRetained Tokens=1922025.0957.3
VisionZipBase Model=LLaVA-1.5-7B, Retained Tokens=192, Reduction Rate=66.7%2026.0257.3
DivPruneRetained Tokens=1922025.0956.97
VisionZipRetained Tokens=1282025.0956.8
VisionZipBase Model=LLaVA-1.5-7B, Retained Tokens=128, Reduction Rate=77.8%2026.0256.8
PDropBase Model=LLaVA-1.5-7B, Retained Tokens=128, Reduction Rate=77.8%2026.0256.6
PDropBase Model=LLaVA-1.5-7B, Retained Tokens=192, Reduction Rate=66.7%2026.0256.5
PyramidDropRetained Tokens=1922025.0956.1
SparseVLMRetained Tokens=1922025.0956.1
SparseVLMBase Model=LLaVA-1.5-7B, Retained Tokens=192, Reduction Rate=66.7%2026.0256.1
DivPruneRetained Tokens=1282025.0956.06
VisionZipRetained Tokens=642025.0955.5
VisionZipBase Model=LLaVA-1.5-7B, Retained Tokens=64, Reduction Rate=88.9%2026.0255.5
ZOO-PruneRetained Tokens=642025.0955.35
PyramidDropRetained Tokens=1282025.0955.1
SparseVLMRetained Tokens=1282025.0954.9
SparseVLMBase Model=LLaVA-1.5-7B, Retained Tokens=128, Reduction Rate=77.8%2026.0254.9
DivPruneRetained Tokens=642025.0954.69
ApETBase Model=LLaVA-1.5-7B, Retained Tokens=192, Reduction Rate=66.7%2026.0254.4
ApETBase Model=LLaVA-1.5-7B, Retained Tokens=128, Reduction Rate=77.8%2026.0253.9
ApETBase Model=LLaVA-1.5-7B, Retained Tokens=64, Reduction Rate=88.9%2026.0253
FastVRetained Tokens=1922025.0952.5
FastVBase Model=LLaVA-1.5-7B, Retained Tokens=192, Reduction Rate=66.7%2026.0252.5
ToMeRetained Tokens=1922025.0952.1
ToMeBase Model=LLaVA-1.5-7B, Retained Tokens=192, Reduction Rate=66.7%2026.0252.1
SparseVLMRetained Tokens=642025.0951.8
SparseVLMBase Model=LLaVA-1.5-7B, Retained Tokens=64, Reduction Rate=88.9%2026.0251.8
FastVRetained Tokens=1282025.0950.6
FastVBase Model=LLaVA-1.5-7B, Retained Tokens=128, Reduction Rate=77.8%2026.0250.6
PDropBase Model=LLaVA-1.5-7B, Retained Tokens=64, Reduction Rate=88.9%2026.0250.6
ToMeRetained Tokens=1282025.0949.1
ToMeBase Model=LLaVA-1.5-7B, Retained Tokens=128, Reduction Rate=77.8%2026.0249.1
FastVRetained Tokens=642025.0947.8
FastVBase Model=LLaVA-1.5-7B, Retained Tokens=64, Reduction Rate=88.9%2026.0247.8
HiREDRetained Tokens=1922025.0947.4
HiREDRetained Tokens=1282025.0946.1
PyramidDropRetained Tokens=642025.0945.9
ToMeRetained Tokens=642025.0945.3
ToMeBase Model=LLaVA-1.5-7B, Retained Tokens=64, Reduction Rate=88.9%2026.0245.3
HiREDRetained Tokens=642025.0944.2