List your company
ResearchFormerly WizWand

OCR-based Visual Question Answering on OCR-VQA

65.6AccuracyCapPa L/14
-0.02417.01334.0551.087Jun 13, 2023Nov 14, 2023Apr 17, 2024Sep 19, 2024Feb 21, 2025Jul 26, 2025Dec 28, 2025
Updated 8mo ago

Evaluation results

MethodLinks
CapPa L/14Backbone Scale=L/14, Evaluation Protocol=Frozen visual representations with single transformer decoder2023.0665.6
CLIP L/14Backbone Scale=L/14, Evaluation Protocol=Frozen visual representations with single transformer decoder2023.0664.1
CapBackbone Scale=B/16, Pre-training Batch Size=8k, Evaluation Protocol=Frozen visual representations with single transformer decoder2023.0662.2
CapPaBackbone Scale=B/16, Pre-training Batch Size=8k, Evaluation Protocol=Frozen visual representations with single transformer decoder2023.0662.2
CLIP* L/14Backbone Scale=L/14, Evaluation Protocol=Frozen visual representations with single transformer decoder2023.0661.3
CLIPBackbone Scale=B/16, Evaluation Protocol=Frozen visual representations with single transformer decoder2023.0660
CLIP* (16k)Backbone Scale=B/16, Pre-training Batch Size=16k, Evaluation Protocol=Frozen visual representations with single transformer decoder2023.0656.5
CLIP* (8k)Backbone Scale=B/16, Pre-training Batch Size=8k, Evaluation Protocol=Frozen visual representations with single transformer decoder2023.0656
VanillaBackbone=LLaVA-Next-7B, Token Reduction Rate=0.0%2025.0551.7
TrimTokenator-LCBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.1249.5
SparseVLMBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.1247.5
VisionZipBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.1247
TrimTokenatorBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.1247
DivPruneBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.1246.5
Original ModelBackbone=LLaVA-1.5-13B, Retention Ratio=1.02025.1246
VTWBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.1246
FastVBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.1245.5
CATPBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.1245.5
MoB (with η-prior)Backbone=LLaVA-Next-7B, Objectives=PA VP, Pruning budget K=320, Token Reduction Rate=88.9%2025.0541.8
DARTBackbone=LLaVA-Next-7B, Objectives=VP, Pruning budget K=320, Token Reduction Rate=88.9%2025.0540.6
FasterVLMBackbone=LLaVA-Next-7B, Objectives=VP, Pruning budget K=320, Token Reduction Rate=88.9%2025.0540.1
MustDropBackbone=LLaVA-Next-7B, Objectives=PA VP, Pruning budget K=320, Token Reduction Rate=88.9%2025.0538.2
FastVBackbone=LLaVA-Next-7B, Objectives=VP, Pruning budget K=320, Token Reduction Rate=88.9%2025.0537.4
MoB (+ η-prior)Backbone=LLaVA-1.5-7B, Objectives=-, Pruning budget K=192, Token Reduction Rate=66.7%2025.0530.7
MoB (w/o η-prior)Backbone=LLaVA-1.5-7B, Objectives=PA VP, Pruning budget K=192, Token Reduction Rate=66.7%2025.0530.4
MoB (w/o η-prior)Backbone=LLaVA-1.5-7B, Objectives=PA VP, Pruning budget K=128, Token Reduction Rate=77.8%2025.0529.9
MoB (+ η-prior)Backbone=LLaVA-1.5-7B, Objectives=-, Pruning budget K=128, Token Reduction Rate=77.8%2025.0529.9
VanillaBackbone=LLaVA-1.5-7B, Token Reduction Rate=0.0%2025.0529.7
DARTBackbone=LLaVA-1.5-7B, Objectives=VP, Pruning budget K=192, Token Reduction Rate=66.7%2025.0529.6
DARTBackbone=LLaVA-1.5-7B, Objectives=VP, Pruning budget K=128, Token Reduction Rate=77.8%2025.0529.6
SparseVLMBackbone=LLaVA-1.5-7B, Objectives=PA, Pruning budget K=192, Token Reduction Rate=66.7%2025.0529.2
FastVBackbone=LLaVA-1.5-7B, Objectives=VP, Pruning budget K=192, Token Reduction Rate=66.7%2025.0529.1
MustDropBackbone=LLaVA-1.5-7B, Objectives=PA VP, Pruning budget K=192, Token Reduction Rate=66.7%2025.0528.9
FastVBackbone=LLaVA-1.5-7B, Objectives=VP, Pruning budget K=128, Token Reduction Rate=77.8%2025.0528.5
MustDropBackbone=LLaVA-1.5-7B, Objectives=PA VP, Pruning budget K=128, Token Reduction Rate=77.8%2025.0528.1
SparseVLMBackbone=LLaVA-1.5-7B, Objectives=PA, Pruning budget K=128, Token Reduction Rate=77.8%2025.0528
MoB (w/o η-prior)Backbone=LLaVA-1.5-7B, Objectives=PA VP, Pruning budget K=64, Token Reduction Rate=88.9%2025.0527.7
MoB (+ η-prior)Backbone=LLaVA-1.5-7B, Objectives=-, Pruning budget K=64, Token Reduction Rate=88.9%2025.0527.7
Original ModelBackbone=Yi-VL-6B, Retention Ratio=1.02025.1227.5
DARTBackbone=LLaVA-1.5-7B, Objectives=VP, Pruning budget K=64, Token Reduction Rate=88.9%2025.0527
SparseVLMBackbone=LLaVA-Next-7B, Objectives=PA, Pruning budget K=320, Token Reduction Rate=88.9%2025.0527
MustDropBackbone=LLaVA-1.5-7B, Objectives=PA VP, Pruning budget K=64, Token Reduction Rate=88.9%2025.0526.7
TrimTokenator-LCBackbone=Yi-VL-6B, Retention Ratio=0.22025.1225.5
DivPruneBackbone=Yi-VL-6B, Retention Ratio=0.22025.1225
SparseVLMBackbone=Yi-VL-6B, Retention Ratio=0.22025.1224.5
FastVBackbone=LLaVA-1.5-7B, Objectives=VP, Pruning budget K=64, Token Reduction Rate=88.9%2025.0524.5
VisionZipBackbone=Yi-VL-6B, Retention Ratio=0.22025.1224
TrimTokenatorBackbone=Yi-VL-6B, Retention Ratio=0.22025.1224
VTWBackbone=Yi-VL-6B, Retention Ratio=0.22025.1223.5
CATPBackbone=Yi-VL-6B, Retention Ratio=0.22025.1223.5
FastVBackbone=Yi-VL-6B, Retention Ratio=0.22025.1223
SparseVLMBackbone=LLaVA-1.5-7B, Objectives=PA, Pruning budget K=64, Token Reduction Rate=88.9%2025.0518
Original ModelBackbone=LLaVA-1.5-7B, Retention Ratio=1.02025.128
TrimTokenator-LCBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.124.5
FastVBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.123.5
CATPBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.123.5
TrimTokenatorBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.123.5
SparseVLMBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.123
VisionZipBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.123
DivPruneBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.123
VTWBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.122.5