List your company
ResearchFormerly WizWand

Visual Question Answering on AI2D (Exact Match)

82.48EMBaseline
66.6270.737574.85578.9725Oct 13, 2023Mar 2, 2024Jul 22, 2024Dec 11, 2024May 2, 2025Sep 21, 2025Feb 10, 2026
Updated 7mo ago

Evaluation results

MethodLinks
BaselineCompression Ratio=0%, Backbone=Qwen-2.5-7B-Instruct2026.0282.48
BaselineBase Model=Qwen-2.5-VL-7B-Instruct, Retained Tokens=100%, Compression Ratio=0%2026.0282.48
PaLI-XOCR pipeline input=true, Resolution=812x8122023.1081.4
PaLI-XOCR pipeline input=false, Resolution=812x8122023.1081.2
IDPrunerCompression Ratio=75%, Backbone=Qwen-2.5-7B-Instruct2026.0280.51
IDPrunerBase Model=Qwen-2.5-VL-7B-Instruct, Retained Tokens=25%, Compression Ratio=75%2026.0280.51
VisionSelectorCompression Ratio=75%, Backbone=Qwen-2.5-7B-Instruct2026.0279.6
VisionSelectorBase Model=Qwen-2.5-VL-7B-Instruct, Retained Tokens=25%, Compression Ratio=75%2026.0279.6
SCOPECompression Ratio=75%, Backbone=Qwen-2.5-7B-Instruct2026.0278.92
SCOPEBase Model=Qwen-2.5-VL-7B-Instruct, Retained Tokens=25%, Compression Ratio=75%2026.0278.92
DivPruneCompression Ratio=75%, Backbone=Qwen-2.5-7B-Instruct2026.0277.98
DivPruneBase Model=Qwen-2.5-VL-7B-Instruct, Retained Tokens=25%, Compression Ratio=75%2026.0277.98
VisPrunerCompression Ratio=75%, Backbone=Qwen-2.5-7B-Instruct2026.0277.62
VisPrunerBase Model=Qwen-2.5-VL-7B-Instruct, Retained Tokens=25%, Compression Ratio=75%2026.0277.62
HiPruneCompression Ratio=75%, Backbone=Qwen-2.5-7B-Instruct2026.0277.49
HiPruneBase Model=Qwen-2.5-VL-7B-Instruct, Retained Tokens=25%, Compression Ratio=75%2026.0277.49
VisionZipCompression Ratio=75%, Backbone=Qwen-2.5-7B-Instruct2026.0277.4
VisionZipBase Model=Qwen-2.5-VL-7B-Instruct, Retained Tokens=25%, Compression Ratio=75%2026.0277.4
FastVCompression Ratio=75%, Backbone=Qwen-2.5-7B-Instruct2026.0275.68
FastVBase Model=Qwen-2.5-VL-7B-Instruct, Retained Tokens=25%, Compression Ratio=75%2026.0275.68
PaLI-3OCR pipeline input=true, Resolution=812x8122023.1075.2
PaLI-3OCR pipeline input=false, Resolution=812x8122023.1075.2
IDPrunerCompression Ratio=90%, Backbone=Qwen-2.5-7B-Instruct2026.0275.16
IDPrunerBase Model=Qwen-2.5-VL-7B-Instruct, Retained Tokens=10%, Compression Ratio=90%2026.0275.16
VisionSelectorCompression Ratio=90%, Backbone=Qwen-2.5-7B-Instruct2026.0274.81
VisionSelectorBase Model=Qwen-2.5-VL-7B-Instruct, Retained Tokens=10%, Compression Ratio=90%2026.0274.81
DARTCompression Ratio=75%, Backbone=Qwen-2.5-7B-Instruct2026.0274.35
DARTBase Model=Qwen-2.5-VL-7B-Instruct, Retained Tokens=25%, Compression Ratio=75%2026.0274.35
SCOPECompression Ratio=90%, Backbone=Qwen-2.5-7B-Instruct2026.0271.63
SCOPEBase Model=Qwen-2.5-VL-7B-Instruct, Retained Tokens=10%, Compression Ratio=90%2026.0271.63
VisionZipCompression Ratio=90%, Backbone=Qwen-2.5-7B-Instruct2026.0270.6
VisionZipBase Model=Qwen-2.5-VL-7B-Instruct, Retained Tokens=10%, Compression Ratio=90%2026.0270.6
DivPruneCompression Ratio=90%, Backbone=Qwen-2.5-7B-Instruct2026.0270.11
DivPruneBase Model=Qwen-2.5-VL-7B-Instruct, Retained Tokens=10%, Compression Ratio=90%2026.0270.11
VisPrunerCompression Ratio=90%, Backbone=Qwen-2.5-7B-Instruct2026.0269.88
VisPrunerBase Model=Qwen-2.5-VL-7B-Instruct, Retained Tokens=10%, Compression Ratio=90%2026.0269.88
HiPruneCompression Ratio=90%, Backbone=Qwen-2.5-7B-Instruct2026.0269.82
HiPruneBase Model=Qwen-2.5-VL-7B-Instruct, Retained Tokens=10%, Compression Ratio=90%2026.0269.82
DARTCompression Ratio=90%, Backbone=Qwen-2.5-7B-Instruct2026.0267.88
DARTBase Model=Qwen-2.5-VL-7B-Instruct, Retained Tokens=10%, Compression Ratio=90%2026.0267.88
FastVCompression Ratio=90%, Backbone=Qwen-2.5-7B-Instruct2026.0267.23
FastVBase Model=Qwen-2.5-VL-7B-Instruct, Retained Tokens=10%, Compression Ratio=90%2026.0267.23