List your company
ResearchFormerly WizWand

Visual Question Answering on ChartQA (Score Metric)

90.9ScoreSPOT-E
1.66824.8344871.166Apr 23, 2026May 2, 2026May 11, 2026May 21, 2026May 30, 2026Jun 8, 2026Jun 18, 2026
Updated 4mo ago

Evaluation results

MethodLinks
SPOT-EBase Model=Qwen3-VL-32B2026.0690.9
SPOT-EBase Model=Qwen2.5-VL-32B2026.0690.6
Qwen3-VL-32BBase Model=Qwen3-VL-32B2026.0690.2
Qwen2.5-VL-32BBase Model=Qwen2.5-VL-32B2026.0689.8
SPOT-EBase Model=InternVL2.5-26B2026.0688.8
InternVL2.5-26BBase Model=InternVL2.5-26B2026.0687.5
SPOT-EBase Model=LLaVA-OV-72B2026.0687.1
LLaVA-OV-72BBase Model=LLaVA-OV-72B2026.0685.6
Pelican-UnifiedModel Category=Our Unified Model2026.0581.5
Qwen3-VL-4B-InstructModel Category=Vision-Language Models2026.0581.1
MolmoActModel Category=Vision-Language-Action Models2026.0555.9
Gemma3-4B-ITModel Category=Vision-Language Models2026.0550.3
Decoupled DiLoCoModel Scale=Gemma 9B, Method=DiLoCo2026.0423
DPModel Scale=Gemma 9B, Method=DP2026.0421.6
DPModel Scale=Gemma 5B, Method=DP2026.0419
EL2NTraining Budget=20%, Backbone=LLaVA-1.5-13B2026.0517.9
Full-FinetuneTraining Budget=100%, Backbone=LLaVA-1.5-13B2026.0517.5
Decoupled DiLoCoModel Scale=Gemma 5B, Method=DiLoCo2026.0417.3
D2-PruningTraining Budget=20%, Backbone=LLaVA-1.5-13B2026.0517.3
ICONSTraining Budget=20%, Backbone=LLaVA-1.5-13B2026.0517.1
MAGICTraining Budget=20%, Backbone=LLaVA-1.5-13B2026.0517.1
COINCIDETraining Budget=20%, Backbone=LLaVA-1.5-13B2026.0517
RDSTraining Budget=20%, Backbone=LLaVA-1.5-13B2026.0516.8
Self-SupTraining Budget=20%, Backbone=LLaVA-1.5-13B2026.0516.6
CLIP-ScoreTraining Budget=20%, Backbone=LLaVA-1.5-13B2026.0516.4
PerplexityTraining Budget=20%, Backbone=LLaVA-1.5-13B2026.0516.4
SemDeDupTraining Budget=20%, Backbone=LLaVA-1.5-13B2026.0516.4
Self-FilterTraining Budget=20%, Backbone=LLaVA-1.5-13B2026.0516
RandomTraining Budget=20%, Backbone=LLaVA-1.5-13B2026.0515.1
Decoupled DiLoCoModel Scale=Gemma 2B, Method=DiLoCo2026.0413.3
DPModel Scale=Gemma 2B, Method=DP2026.0412.2
π0.5Model Category=Vision-Language-Action Models2026.055.1