List your company
ResearchFormerly WizWand

Chart Question Answering on ChartVQA

78.5AccuracyGPT-4V
15.0631.534864.47Jan 29, 2024Feb 18, 2024Mar 9, 2024Mar 29, 2024Apr 18, 2024May 8, 2024May 28, 2024
Updated 8mo ago

Evaluation results

MethodLinks
GPT-4V2024.0178.5
Qwen-VL-Plus2024.0178.1
Gemini-Pro2024.0174.1
InternLM-XComposer2Number of Parameters=7B2024.0172.6
CogAgentNumber of Parameters=18B2024.0168.4
LLaVA-NeXT+CALLLM=Vicuna-13B, Resolution setting=High resolution2024.0567.2
LLaVA-NeXT+CALLLM=Vicuna-7B, Resolution setting=High resolution2024.0564.3
LLaVA-NeXTLLM=Vicuna-13B, Resolution setting=High resolution2024.0563.8
LLaVA-NeXTLLM=Vicuna-7B, Resolution setting=High resolution2024.0562.2
MGM-HD+CALLLM=Vicuna-13B, Resolution setting=High resolution2024.0557.2
MGM-HDLLM=Vicuna-13B, Resolution setting=High resolution2024.0555.8
MGM-HD+CALLLM=Vicuna-7B, Resolution setting=High resolution2024.0549.6
MGM-HDLLM=Vicuna-7B, Resolution setting=High resolution2024.0549.3
MGMLLM=Vicuna-13B, Resolution setting=Low resolution2024.0548.8
MGM+CALLLM=Vicuna-13B, Resolution setting=Low resolution2024.0548
MGMLLM=Vicuna-7B, Resolution setting=Low resolution2024.0543.2
MGM+CALLLM=Vicuna-7B, Resolution setting=Low resolution2024.0542.8
MGM+CALLLM=Gemma-2B, Resolution setting=Low resolution2024.0527
MGMLLM=Gemma-2B, Resolution setting=Low resolution2024.0523.4
LLaVA-1.5+CALLLM=Vicuna-13B, Resolution setting=Low resolution2024.0518.4
LLaVA-1.5LLM=Vicuna-13B, Resolution setting=Low resolution2024.0518.3
LLaVA-1.5LLM=Vicuna-7B, Resolution setting=Low resolution2024.0517.5
LLaVA-1.5+CALLLM=Vicuna-7B, Resolution setting=Low resolution2024.0517.5