Chart Question Answering on ChartQA augmented
95.91AccuracyChartAgent
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ChartAgentbackbone=Qwen3VL-235b2025.12 | 95.91 | — | — | — | |
| Qwen3VL-235bcategory=General MLLM2025.12 | 94.8 | — | — | — | |
| ChartAgentbackbone=Qwen3VL-30b2025.12 | 94.62 | — | — | — | |
| TinyChartcategory=Chart Model2025.12 | 94.48 | — | — | — | |
| Qwen2.5VL-72bcategory=General MLLM2025.12 | 94.35 | — | — | — | |
| Qwen3VL-30bcategory=General MLLM2025.12 | 93.2 | — | — | — | |
| ChartLlamacategory=Chart Model2025.12 | 93.12 | — | — | — | |
| ChartMoEcategory=Chart Model2025.12 | 90.96 | — | — | — | |
| ChartGemmacategory=Chart Model2025.12 | 90.8 | — | — | — | |
| Vanilla PG2Visual Tokens=1024, Resolution=448x448, Fine-tuning=true2026.05 | 88.3 | — | — | — | |
| Gemini-2.5category=General MLLM2025.12 | 86.72 | — | — | — | |
| MatChacategory=Chart Model2025.12 | 86.64 | — | — | — | |
| PARCELVisual Tokens=1024, Resolution=448x448, Fine-tuning=true2026.05 | 85.8 | — | — | — | |
| PARCELVisual Tokens=256, Resolution=448x448, Fine-tuning=true2026.05 | 85.6 | — | — | — | |
| GPT-4ocategory=General MLLM2025.12 | 85.52 | — | — | — | |
| ChartInstructcategory=Chart Model2025.12 | 85.04 | — | — | — | |
| M3Visual Tokens=1024, Resolution=448x448, Fine-tuning=true2026.05 | 85 | — | — | — | |
| MQTVisual Tokens=256, Resolution=448x448, Fine-tuning=true2026.05 | 84.3 | — | — | — | |
| MQTVisual Tokens=1024, Resolution=448x448, Fine-tuning=true2026.05 | 83.5 | — | — | — | |
| M3Visual Tokens=256, Resolution=448x448, Fine-tuning=true2026.05 | 83.4 | — | — | — | |
| UniChartcategory=Chart Model2025.12 | 83.28 | — | — | — | |
| Claude4category=General MLLM2025.12 | 82.72 | — | — | — | |
| PARCELVisual Tokens=64, Resolution=448x448, Fine-tuning=true2026.05 | 82.7 | — | — | — | |
| ChartVLMcategory=Chart Model2025.12 | 82.48 | — | — | — | |
| M3Visual Tokens=64, Resolution=448x448, Fine-tuning=true2026.05 | 82.3 | — | — | — | |
| MQTVisual Tokens=64, Resolution=448x448, Fine-tuning=true2026.05 | 81.8 | — | — | — | |
| ChartInstruct-Flan-T5-XL#Params=3B, System Architecture=End-to-End2024.03 | — | 85.04 | — | — | |
| ChartInstruct-Flan-T5-XL#Params=3B, System Architecture=Pipeline2024.03 | — | 93.84 | — | — | |
| ChartInstruct-Llama#Params=7B, System Architecture=End-to-End2024.03 | — | 87.76 | — | — | |
| ChartInstruct-Llama#Params=7B, System Architecture=Pipeline2024.03 | — | 82.4 | — | — | |
| M3Visual Tokens=2562026.05 | — | — | 64.1 | 84.9 | |
| M3Visual Tokens=642026.05 | — | — | 63 | 81.6 | |
| M3Visual Tokens=162026.05 | — | — | 59.9 | 75.5 | |
| MatCha#Params=282M2024.03 | — | 90.2 | — | — | |
| MQTVisual Tokens=2562026.05 | — | — | 66 | 90 | |
| MQTVisual Tokens=642026.05 | — | — | 64.8 | 86.2 | |
| MQTVisual Tokens=162026.05 | — | — | 58.2 | 74.2 | |
| PARCELVisual Tokens=2562026.05 | — | — | 66.2 | 90.8 | |
| PARCELVisual Tokens=642026.05 | — | — | 66.3 | 90 | |
| PARCELVisual Tokens=162026.05 | — | — | 58.8 | 77.1 | |
| PG2Visual Tokens=2562026.05 | — | — | 72.5 | — | |
| Pix2Struct#Params=282M2024.03 | — | 81.6 | — | — | |
| T5#Params=222M2024.03 | — | 56.96 | — | — | |
| UniChart#Params=201M2024.03 | — | 88.56 | — | — | |
| VisionTaPasSystem Architecture=Vision-Language2024.03 | — | 61.44 | — | — | |
| VL-T5System Architecture=Vision-Language2024.03 | — | 56.88 | — | — |