Chart Information Extraction on ChartQA (val)
85.91mPrecision (IoU Range)StructChart
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| StructChartTrain Set=Real Merging, Tolerance=high2023.09 | 85.91 | 89.87 | 85.51 | 83.62 | — | |
| StructChartTrain Set=Real&Sim Merging, Tolerance=high2023.09 | 85.68 | 89.9 | 85.42 | 83.58 | — | |
| StructChartTrain Set=Real&Sim Merging, Tolerance=slight2023.09 | 83.11 | 87.61 | 83.01 | 80.01 | — | |
| StructChartTrain Set=ChartQA, Tolerance=high2023.09 | 82.74 | 87.03 | 82.1 | 80.11 | — | |
| StructChartTrain Set=Real Merging, Tolerance=slight2023.09 | 82.27 | 86.74 | 82.01 | 79.26 | — | |
| DeplotTrain Set=ChartQA+PlotQA+C.D., Tolerance=high2023.09 | 81.5 | 87.59 | 80.87 | 78.12 | — | |
| StructChartTrain Set=ChartQA, Tolerance=slight2023.09 | 77.92 | 82.2 | 77.46 | 75.19 | — | |
| DeplotTrain Set=ChartQA+PlotQA+C.D., Tolerance=slight2023.09 | 76.66 | 82.29 | 76.61 | 72.82 | — | |
| StructChartTrain Set=Real&Sim Merging, Tolerance=strict2023.09 | 71.87 | 76.83 | 71.53 | 67.05 | 66.42 | |
| MatchaTrain Set=ChartQA+PlotQA+C.D., Tolerance=high2023.09 | 71.61 | 75.19 | 71.5 | 68.94 | — | |
| StructChartTrain Set=Real Merging, Tolerance=strict2023.09 | 70.17 | 75.47 | 69.98 | 66.1 | 65.06 | |
| StructChartTrain Set=ChartQA, Tolerance=strict2023.09 | 67.7 | 72.73 | 67.14 | 64.58 | 63.26 | |
| MatchaTrain Set=ChartQA+PlotQA+C.D., Tolerance=slight2023.09 | 65.98 | 70.45 | 65.72 | 62.5 | — | |
| DeplotTrain Set=ChartQA+PlotQA+C.D., Tolerance=strict2023.09 | 63.31 | 70.08 | 63.26 | 58.14 | 56.63 | |
| MatchaTrain Set=ChartQA+PlotQA+C.D., Tolerance=strict2023.09 | 51.6 | 58.14 | 51.14 | 46.78 | 44.6 |