Chart Schema Parsing on CycleChart-Bench (test)
97.32ROUGE-L RecallCycleChart-7B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CycleChart-7BEvaluation Mode=Zero-shot, Training Data=CycleChart-Bench2025.12 | 97.32 | 89.2574 | 99.73 | 97.45 | 100 | |
| gemini-2.5-flashEvaluation Mode=Zero-shot, Model Category=General VLM2025.12 | 95.09 | 33.7034 | 88.44 | 68.86 | 91.41 | |
| gemini-2.5-proEvaluation Mode=Zero-shot, Model Category=General VLM2025.12 | 94.55 | 54.5638 | 89.75 | 78.46 | 91.41 | |
| CycleChart-3BEvaluation Mode=Zero-shot, Training Data=CycleChart-Bench2025.12 | 94.43 | 77.2901 | 98.13 | 90.11 | 99.85 | |
| gpt-4.1Evaluation Mode=Zero-shot, Model Category=General VLM2025.12 | 92.91 | 23.1719 | 68.71 | 51.28 | 71.63 | |
| claude-3.5-sonnetEvaluation Mode=Zero-shot, Model Category=General VLM2025.12 | 88.94 | 25.1227 | 79.94 | 60.3 | 84.82 | |
| glm-4.5vEvaluation Mode=Zero-shot, Model Category=General VLM2025.12 | 87.04 | 20.8042 | 53.21 | 39.7 | 56.29 |