List your company
ResearchFormerly WizWand

Document Visual Question Answering on DocVQA (ANLS)

96.4ANLSFull Precision
5.9229.4152.976.39May 28, 2026Jun 2, 2026Jun 8, 2026Jun 14, 2026Jun 20, 2026Jun 26, 2026Jul 2, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Full PrecisionModel=Qwen2.5-VL-72B-Instruct, Weight bits=16 bit, Memory=136.74 GB, Evaluation protocol=zero-shot2026.0796.4
Full PrecisionModel=Qwen2.5-VL-7B-Instruct, Weight bits=16 bit, Memory=15.45 GB, Evaluation protocol=zero-shot2026.0795.17
Full PrecisionModel=Qwen2.5-VL-32B-Instruct, Weight bits=16 bit, Memory=62.31 GB, Evaluation protocol=zero-shot2026.0794.8
GPTQModel=Qwen2.5-VL-72B-Instruct, Weight bits=3 bit, Memory=28.61 GB, Evaluation protocol=zero-shot2026.0794.25
GPTQModel=Qwen2.5-VL-7B-Instruct, Weight bits=3 bit, Memory=2.66 GB, Evaluation protocol=zero-shot2026.0793.36
SPOT-EBase Model=Gemini-2.5-Flash, Source Type=Closed-Source, Test-time Adaptation=SPOT-E2026.0693
GPTQModel=Qwen2.5-VL-32B-Instruct, Weight bits=3 bit, Memory=12.71 GB, Evaluation protocol=zero-shot2026.0792.65
SAB-LVLMModel=Qwen2.5-VL-72B-Instruct, Weight bits=1.07 bit, Memory=23.23 GB, Evaluation protocol=zero-shot2026.0792.56
SPOT-EBase Model=GPT-4o, Source Type=Closed-Source, Test-time Adaptation=SPOT-E2026.0692.3
Gemini-2.5-FlashBase Model=Gemini-2.5-Flash, Source Type=Closed-Source, Test-time Adaptation=None2026.0691.5
GPT-4oBase Model=GPT-4o, Source Type=Closed-Source, Test-time Adaptation=None2026.0691.1
ARB-LLMModel=Qwen2.5-VL-72B-Instruct, Weight bits=1.19 bit, Memory=23.23 GB, Evaluation protocol=zero-shot2026.0790.42
SAB-LVLMModel=Qwen2.5-VL-32B-Instruct, Weight bits=1.07 bit, Memory=10.28 GB, Evaluation protocol=zero-shot2026.0790.36
BiLLMModel=Qwen2.5-VL-72B-Instruct, Weight bits=1.08 bit, Memory=24.23 GB, Evaluation protocol=zero-shot2026.0790.1
ARB-LLMModel=Qwen2.5-VL-32B-Instruct, Weight bits=1.16 bit, Memory=10.28 GB, Evaluation protocol=zero-shot2026.0790
SPOT-EBase Model=GPT-4o-mini, Source Type=Closed-Source, Test-time Adaptation=SPOT-E2026.0688
SPOT-EBase Model=Qwen3-VL-8B, Source Type=Open-Source, Test-time Adaptation=SPOT-E2026.0686.8
SPOT-EBase Model=Qwen2.5-VL-7B, Source Type=Open-Source, Test-time Adaptation=SPOT-E2026.0686.5
Qwen3-VL-8BBase Model=Qwen3-VL-8B, Source Type=Open-Source, Test-time Adaptation=None2026.0686.2
GPT-4o-miniBase Model=GPT-4o-mini, Source Type=Closed-Source, Test-time Adaptation=None2026.0686
BaselineKeep ratio=100%, FLOPs Saved=—2026.0585.91
AsymVLMKeep ratio=75%, FLOPs Saved=28%2026.0585.75
Qwen2.5-VL-7BBase Model=Qwen2.5-VL-7B, Source Type=Open-Source, Test-time Adaptation=None2026.0685.7
SAB-LVLMModel=Qwen2.5-VL-7B-Instruct, Weight bits=1.07 bit, Memory=2.14 GB, Evaluation protocol=zero-shot2026.0785.34
PB-LLMModel=Qwen2.5-VL-72B-Instruct, Weight bits=1.70 bit, Memory=22.99 GB, Evaluation protocol=zero-shot2026.0785.33
AsymVLMKeep ratio=65%, FLOPs Saved=39%2026.0585.07
SparseVLMKeep ratio=75%, FLOPs Saved=18%2026.0584.58
SparseVLMKeep ratio=65%, FLOPs Saved=35%2026.0584.4
SPOT-EBase Model=InternVL3-8B, Source Type=Open-Source, Test-time Adaptation=SPOT-E2026.0683.7
FastVKeep ratio=75%, FLOPs Saved=0%2026.0583.53
SPOT-EBase Model=InternVL2.5-8B, Source Type=Open-Source, Test-time Adaptation=SPOT-E2026.0683.5
SparseVLMKeep ratio=50%, FLOPs Saved=47%2026.0583.38
ChatVLA2026.0683.3
AsymVLMKeep ratio=50%, FLOPs Saved=54%2026.0583.22
SPOT-EBase Model=LLaVA-OV-7B, Source Type=Open-Source, Test-time Adaptation=SPOT-E2026.0682.8
InternVL3-8BBase Model=InternVL3-8B, Source Type=Open-Source, Test-time Adaptation=None2026.0682.7
SPOT-EBase Model=LLaVA-NeXT-7B, Source Type=Open-Source, Test-time Adaptation=SPOT-E2026.0682
InternVL2.5-8BBase Model=InternVL2.5-8B, Source Type=Open-Source, Test-time Adaptation=None2026.0682
FastVKeep ratio=65%, FLOPs Saved=0%2026.0581.74
LLaVA-OV-7BBase Model=LLaVA-OV-7B, Source Type=Open-Source, Test-time Adaptation=None2026.0681
ARB-LLMModel=Qwen2.5-VL-7B-Instruct, Weight bits=1.07 bit, Memory=2.14 GB, Evaluation protocol=zero-shot2026.0780.48
SyVLA2026.0680.01
LLaVA-NeXT-7BBase Model=LLaVA-NeXT-7B, Source Type=Open-Source, Test-time Adaptation=None2026.0680
FastVKeep ratio=50%, FLOPs Saved=0%2026.0577.3
PB-LLMModel=Qwen2.5-VL-32B-Instruct, Weight bits=1.70 bit, Memory=10.24 GB, Evaluation protocol=zero-shot2026.0766.1
Wall-Oss2026.0663.62
BiLLMModel=Qwen2.5-VL-32B-Instruct, Weight bits=1.08 bit, Memory=10.73 GB, Evaluation protocol=zero-shot2026.0760.85
BiLLMModel=Qwen2.5-VL-7B-Instruct, Weight bits=1.08 bit, Memory=2.24 GB, Evaluation protocol=zero-shot2026.0733.08
PB-LLMModel=Qwen2.5-VL-7B-Instruct, Weight bits=1.17 bit, Memory=2.15 GB, Evaluation protocol=zero-shot2026.079.4