List your company
ResearchFormerly WizWand

Text-based Visual Question Answering on TextVQA (VQAText & Average Metrics)

82.7VQAText ScoreFull Precision
-3.30819.02141.3563.679Jun 1, 2026Jun 6, 2026Jun 11, 2026Jun 16, 2026Jun 21, 2026Jun 26, 2026Jul 2, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Full PrecisionModel=InternVL3.5-38B-Instruct, Weight bits=16 bit, Memory=71.51 GB2026.0782.7—
GPTQModel=InternVL3.5-38B-Instruct, Weight bits=3 bit, Memory=12.71 GB2026.0780.22—
SAB-LVLMModel=InternVL3.5-38B-Instruct, Weight bits=1.06 bit, Memory=10.27 GB2026.0778.06—
Full PrecisionModel=InternVL3.5-14B-Instruct, Weight bits=16 bit, Memory=28.16 GB2026.0777.8—
Full PrecisionModel=InternVL3.5-8B-Instruct, Weight bits=16 bit, Memory=15.89 GB2026.0777.38—
ARB-LLMModel=InternVL3.5-38B-Instruct, Weight bits=1.08 bit, Memory=10.27 GB2026.0777.37—
GPTQModel=InternVL3.5-14B-Instruct, Weight bits=3 bit, Memory=5.38 GB2026.0774.9—
GPTQModel=InternVL3.5-8B-Instruct, Weight bits=3 bit, Memory=2.83 GB2026.0774.82—
SAB-LVLMModel=InternVL3.5-14B-Instruct, Weight bits=1.07 bit, Memory=4.33 GB2026.0771.03—
ARB-LLMModel=InternVL3.5-14B-Instruct, Weight bits=1.07 bit, Memory=4.33 GB2026.0770.77—
PB-LLMModel=InternVL3.5-38B-Instruct, Weight bits=1.70 bit, Memory=10.24 GB2026.0765.06—
LLaVA-Next-7BBase Model=LLaVA-Next-7B, Reduction Ratio=100%, Retained Tokens=28802026.0664.9100
VisPrunerBase Model=LLaVA-Next-7B, Reduction Ratio=11.1%, Retained Tokens=3202026.0659.190.8
HoloVBase Model=LLaVA-Next-7B, Reduction Ratio=11.1%, Retained Tokens=3202026.0657.187.5
VisPrunerBase Model=LLaVA-Next-7B, Reduction Ratio=5.5%, Retained Tokens=1602026.0657.186.7
HoloV + RESTOREBase Model=LLaVA-Next-7B, Reduction Ratio=11.1%, Retained Tokens=3202026.0656.192
HoloVBase Model=LLaVA-Next-7B, Reduction Ratio=5.5%, Retained Tokens=1602026.065686.3
VisPruner + RESTOREBase Model=LLaVA-Next-7B, Reduction Ratio=11.1%, Retained Tokens=3202026.0655.991.9
VisionzipBase Model=LLaVA-Next-7B, Reduction Ratio=11.1%, Retained Tokens=3202026.0655.288.9
VisionzipBase Model=LLaVA-Next-7B, Reduction Ratio=5.5%, Retained Tokens=1602026.0654.584.9
HoloV + RESTOREBase Model=LLaVA-Next-7B, Reduction Ratio=5.5%, Retained Tokens=1602026.0653.189
Visionzip + RESTOREBase Model=LLaVA-Next-7B, Reduction Ratio=11.1%, Retained Tokens=3202026.065390.5
VisPruner + RESTOREBase Model=LLaVA-Next-7B, Reduction Ratio=5.5%, Retained Tokens=1602026.065288.5
DivPruneBase Model=LLaVA-Next-7B, Reduction Ratio=11.1%, Retained Tokens=3202026.0651.688.8
DivPrune + RESTOREBase Model=LLaVA-Next-7B, Reduction Ratio=11.1%, Retained Tokens=3202026.0651.490.2
Visionzip + RESTOREBase Model=LLaVA-Next-7B, Reduction Ratio=5.5%, Retained Tokens=1602026.0651.287.9
DivPruneBase Model=LLaVA-Next-7B, Reduction Ratio=5.5%, Retained Tokens=1602026.0651.286.3
DivPrune + RESTOREBase Model=LLaVA-Next-7B, Reduction Ratio=5.5%, Retained Tokens=1602026.0648.387.2
SAB-LVLMModel=InternVL3.5-8B-Instruct, Weight bits=1.07 bit, Memory=2.28 GB2026.0742.04—
BiLLMModel=InternVL3.5-38B-Instruct, Weight bits=1.07 bit, Memory=10.72 GB2026.0737.09—
BiLLMModel=InternVL3.5-14B-Instruct, Weight bits=1.07 bit, Memory=4.53 GB2026.0731.65—
ARB-LLMModel=InternVL3.5-8B-Instruct, Weight bits=1.07 bit, Memory=2.28 GB2026.0730.83—
BiLLMModel=InternVL3.5-8B-Instruct, Weight bits=1.08 bit, Memory=2.39 GB2026.070.23—
PB-LLMModel=InternVL3.5-8B-Instruct, Weight bits=1.70 bit, Memory=2.28 GB2026.070—
PB-LLMModel=InternVL3.5-14B-Instruct, Weight bits=1.70 bit, Memory=4.34 GB2026.070—