List your company
ResearchFormerly WizWand

Real-world Question Answering on RWQA

76.99RWQA AccuracyQwen3-VL-235B
36.617247.098657.5868.0614Apr 14, 2025Jun 22, 2025Aug 30, 2025Nov 8, 2025Jan 16, 2026Mar 26, 2026Jun 4, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Qwen3-VL-235BToken Retention Ratio=100%2026.0576.99
F3AToken Retention Ratio=60%2026.0576.86
DivPruneToken Retention Ratio=60%2026.0575.94
Qwen3-VL-32BToken Ratio=100%2026.0575.82
CDPrunerToken Retention Ratio=60%2026.0575.82
VisionZipToken Retention Ratio=60%2026.0575.66
F3AToken Retention Ratio=40%2026.0575.21
FastVToken Retention Ratio=60%2026.0574.98
FLAMODEL=4B, Precision=FP2026.0674.77
F3AToken Ratio=60%2026.0574.64
VisionZipToken Retention Ratio=40%2026.0574.21
CDPrunerToken Retention Ratio=40%2026.0574.11
DivPruneToken Retention Ratio=40%2026.0574.02
F3AToken Ratio=40%2026.0573.33
FLAMODEL=4B, Precision=W4A162026.0673.33
F3AToken Retention Ratio=20%2026.0573.2
FastVToken Retention Ratio=40%2026.0572.98
Multiplication-Only Matrix Inversion ApproximationMODEL=4B, Precision=W4A162026.0672.81
SGT-BAGELParams=7B+7B‡2026.0572.42
DivPruneToken Ratio=60%2026.0571.63
DivPruneToken Retention Ratio=20%2026.0571.42
BAGELParams=7B+7B‡2026.0571.26
CDPrunerToken Ratio=60%2026.0571.11
Molmo 7B# Vis tok.=12002025.0471.1
VisionZipToken Retention Ratio=20%2026.0571.03
CDPrunerToken Retention Ratio=20%2026.0570.85
VisionZipToken Ratio=60%2026.0570.07
FastVToken Ratio=60%2026.0569.02
CDPrunerToken Ratio=40%2026.0568.76
Qwen2.5VL 7B# Vis tok.=14002025.0468.4
DivPruneToken Ratio=40%2026.0568.1
VisionZipToken Ratio=20%2026.0567.71
UniWorld-v1Params=7B+12B‡2026.0567.58
FLARE-X 8B# Vis tok.=14002025.0466.9
FastVToken Retention Ratio=20%2026.0566.72
VisionZipToken Ratio=40%2026.0566.54
Eagle 8B# Vis tok.=10242025.0466.5
UniMRGParams=3.6B2026.0566.01
LLaVA-OneVision 7B# Vis tok.=24002025.0465.5
Qwen2.5VL 3B# Vis tok.=14002025.0465.4
FLARE-L 8B# Vis tok.=6302025.0465.4
OpenUniParams=2B2026.0565.23
SGT-Gen2Params=3B+4B‡2026.0565.1
OmniGen2Params=3B+4B‡2026.0564.41
DeepSeek-VL2-Tiny# Vis tok.=15002025.0464.2
Cambrain 8B# Vis tok.=5762025.0464.2
Florence-VL 8B# Vis tok.=5762025.0464.2
UniLIPParams=2B2026.0564.18
FLARE-X 3B# Vis tok.=14002025.0463.7
MiniCPM-Llama3-V-2.5 8B# Vis tok.=4002025.0463.5
FastVToken Ratio=40%2026.0562.75
DivPruneToken Ratio=20%2026.0562.35
FLAMODEL=0.8B, Precision=FP2026.0662.35
FLARE-L 3B# Vis tok.=6302025.0462.1
CDPrunerToken Ratio=20%2026.0561.96
F3AToken Ratio=20%2026.0561.83
Qwen2-VL-2B#Params=2B, TFLOPs=0.42025.0660.7
LaTtE-Flow#Params=2B, TFLOPs=0.42025.0660.7
Florence-VL 3B# Vis tok.=5762025.0460.4
Multiplication-Only Matrix Inversion ApproximationMODEL=0.8B, Precision=W4A162026.0660.39
MetaMorph#Params=8B, TFLOPs=1.12025.0658.3
Emu3Params=8B2026.0557.4
EMU3#Params=8B, TFLOPs=4.12025.0657.4
FLAMODEL=0.8B, Precision=W4A162026.0656.08
MiniCPM-V-2.0 3B# Vis tok.=4002025.0455.8
FastVToken Ratio=20%2026.0553.99
Phi 3.5-Vision# Vis tok.=21002025.0453.5
HarmonParams=1.5B2026.0548
VILA-U#Params=7B, TFLOPs=3.62025.0646.6
ReCA-HarmonParams=1.5B2026.0543.53
Janus-ProParams=7B2026.0541.83
Chameleon#Params=34B, TFLOPs=17.42025.0639.2
ChameleonParams=7B2026.0539
Chameleon#Params=7B, TFLOPs=3.62025.0639
Show-o512Params=1.3B2026.0538.17