Chart Information Extraction on PlotQA (val)
89.98mPrecision (0.5:0.05:0.95)StructChart
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| StructChartTrain Set=Real&Sim Merging, Tolerance=high2023.09 | 89.98 | 95.47 | 89.35 | 85.91 | — | |
| StructChartTrain Set=Real Merging, Tolerance=high2023.09 | 89.21 | 94.66 | 88.6 | 85.57 | — | |
| StructChartTrain Set=Real&Sim Merging, Tolerance=slight2023.09 | 86.12 | 92.34 | 85.9 | 81.38 | — | |
| StructChartTrain Set=Real Merging, Tolerance=slight2023.09 | 85.89 | 92.1 | 85.69 | 81.18 | — | |
| StructChartTrain Set=PlotQA, Tolerance=high2023.09 | 82.71 | 89.22 | 82.23 | 78.61 | — | |
| StructChartTrain Set=PlotQA, Tolerance=slight2023.09 | 78.48 | 85.19 | 77.84 | 74.05 | — | |
| DeplotTrain Set=ChartQA+PlotQA+C.D., Tolerance=high2023.09 | 74.71 | 96.79 | 80.34 | 59.92 | — | |
| DeplotTrain Set=ChartQA+PlotQA+C.D., Tolerance=slight2023.09 | 69.69 | 86.64 | 74.35 | 54.63 | — | |
| StructChartTrain Set=Real&Sim Merging, Tolerance=strict2023.09 | 45.96 | 59.01 | 45.69 | 35.63 | 36.12 | |
| StructChartTrain Set=Real Merging, Tolerance=strict2023.09 | 45.49 | 58.55 | 45.25 | 35.21 | 33.85 | |
| StructChartTrain Set=PlotQA, Tolerance=strict2023.09 | 19.95 | 25 | 19.31 | 17.65 | 17.36 | |
| DeplotTrain Set=ChartQA+PlotQA+C.D., Tolerance=strict2023.09 | 9.97 | 15.32 | 10.21 | 6.41 | 6.29 | |
| MatchaTrain Set=ChartQA+PlotQA+C.D., Tolerance=high2023.09 | 8.23 | 10.93 | 8.37 | 7.19 | — | |
| MatchaTrain Set=ChartQA+PlotQA+C.D., Tolerance=slight2023.09 | 7.52 | 9.09 | 7.54 | 6.35 | — | |
| MatchaTrain Set=ChartQA+PlotQA+C.D., Tolerance=strict2023.09 | 0.48 | 0.89 | 0.48 | 0.36 | 0.36 |