ChartQA
Benchmarks
TaskDatasetSOTA resultTrendResults
ChartQA
2,577.2Generated Token Length (tokens)
9
ChartQA
77.72Relaxed Human Split Accuracy
9
ChartQAPro
55.8Accuracy
9
ChartQA augmented questions (test)
91.36Relaxed Accuracy
9
ChartQA human questions subset (test)
67.6Relaxed Accuracy
9
ChartQA 2022 (test)
86.5Overall Score
8
ChartQA Vertical (test)
81.7Accuracy
8
ChartQA Horizontal (test)
81.3Accuracy
8
ChartQA
2.67Speedup Ratio (S)
8
ChartQA Pro clean
72.55Accuracy
8
ChartQA v1.0 (test)
88.8Overall Accuracy
8
ChartQA
0.895Accuracy
8
ChartQA
88.1ChartQA Score
7
ChartQA
86.4Score
7
ChartQA
75.72Prism Score
7
ChartQA
89.5Pass@1
7
ChartQAPro
71.2Pass@1
6
ChartQA
60.34Score
6
ChartQA
2.7Gain Score
6
ChartQA
62.68MRR
6
ChartQA
87.4Accuracy
6
ChartQA
0Spearman Rank Correlation Accuracy
5
ChartQA
0.765Kendall's Tau
5
ChartQA H
87.8Exact Match (EM)
5
ChartQA-SE-Clean
66.2AP (Strict)
5