Chart Question Answering on ChartVQA
78.5AccuracyGPT-4V
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT-4V2024.01 | 78.5 | |
| Qwen-VL-Plus2024.01 | 78.1 | |
| Gemini-Pro2024.01 | 74.1 | |
| InternLM-XComposer2Number of Parameters=7B2024.01 | 72.6 | |
| CogAgentNumber of Parameters=18B2024.01 | 68.4 | |
| LLaVA-NeXT+CALLLM=Vicuna-13B, Resolution setting=High resolution2024.05 | 67.2 | |
| LLaVA-NeXT+CALLLM=Vicuna-7B, Resolution setting=High resolution2024.05 | 64.3 | |
| LLaVA-NeXTLLM=Vicuna-13B, Resolution setting=High resolution2024.05 | 63.8 | |
| LLaVA-NeXTLLM=Vicuna-7B, Resolution setting=High resolution2024.05 | 62.2 | |
| MGM-HD+CALLLM=Vicuna-13B, Resolution setting=High resolution2024.05 | 57.2 | |
| MGM-HDLLM=Vicuna-13B, Resolution setting=High resolution2024.05 | 55.8 | |
| MGM-HD+CALLLM=Vicuna-7B, Resolution setting=High resolution2024.05 | 49.6 | |
| MGM-HDLLM=Vicuna-7B, Resolution setting=High resolution2024.05 | 49.3 | |
| MGMLLM=Vicuna-13B, Resolution setting=Low resolution2024.05 | 48.8 | |
| MGM+CALLLM=Vicuna-13B, Resolution setting=Low resolution2024.05 | 48 | |
| MGMLLM=Vicuna-7B, Resolution setting=Low resolution2024.05 | 43.2 | |
| MGM+CALLLM=Vicuna-7B, Resolution setting=Low resolution2024.05 | 42.8 | |
| MGM+CALLLM=Gemma-2B, Resolution setting=Low resolution2024.05 | 27 | |
| MGMLLM=Gemma-2B, Resolution setting=Low resolution2024.05 | 23.4 | |
| LLaVA-1.5+CALLLM=Vicuna-13B, Resolution setting=Low resolution2024.05 | 18.4 | |
| LLaVA-1.5LLM=Vicuna-13B, Resolution setting=Low resolution2024.05 | 18.3 | |
| LLaVA-1.5LLM=Vicuna-7B, Resolution setting=Low resolution2024.05 | 17.5 | |
| LLaVA-1.5+CALLLM=Vicuna-7B, Resolution setting=Low resolution2024.05 | 17.5 |