ChartMIMIC
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ChartMimic Chart2Python (test)
48.5Error Rate
38
ChartMimic
97.5Execution Rate
30
ChartMimic Direct
96.5Execution Rate
25
ChartMimic
93.5Execution Rate
21
ChartMimic full (test)
97.3Execution Rate
18
ChartMimic
0.978Execution Rate
13
ChartMimic direct v2
86.4Execution Rate
11
ChartMimic Customized
95Execution Rate
9
ChartMimic both-executable
100Box Execution Rate
8
ChartMimic original setting
92Box Execution Rate
8
ChartMimic
66.68Customized Score (Low)
8
ChartMimic
63.8Accuracy
8
ChartMIMIC 1.0 (test)
86.31Text F1 Score
8
ChartMimic
0.86Text Score
6
ChartMimic 300 samples v2 (test)
4.13Visual Fidelity
5
ChartMimic
90.5ISVGEN Score
4
ChartMimic
96.7Execution Rate
2