List your company
ResearchFormerly WizWand

Chart Question Answering on ChartQA (Speedup and Token Length)

2.67Speedup Ratio (S)DREAM-S
1.59881.87692.1552.4331May 30, 2026
Updated 5mo ago

Evaluation results

MethodLinks
DREAM-SModel=LLaVA-v1.6 Vicuna-13B, Temperature=02026.052.674.17
DREAM-SModel=LLaVA-v1.6 Vicuna-13B, Temperature=12026.052.594.09
DREAM-SModel=Pixtral-12B, Temperature=02026.052.43.42
DREAM-SModel=Pixtral-12B, Temperature=12026.052.263.09
DREAM-SModel=LLaVA-v1.6 Vicuna-7B, Temperature=02026.052.044.39
DREAM-SModel=LLaVA-v1.6 Vicuna-7B, Temperature=12026.051.974.22
DREAM-SModel=SmolVLM-2B, Temperature=12026.051.812.48
DREAM-SModel=SmolVLM-2B, Temperature=02026.051.642.28