Chart-to-Code on ChartMimic Direct
96.5Execution RateMSRL
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MSRLParams=7B, Setting=Zero-shot2025.08 | 96.5 | 78.6 | 83.8 | — | |
| VinciCoder-8B-SFTReinforcement Learning Strategy=RL (Visual-ERM)2026.03 | 94.3 | 78 | 88.5 | 83.2 | |
| ChartMaster-7BModel=ChartMaster-7B2026.03 | 93.3 | 74.5 | 82.1 | 78.3 | |
| GPT-4oParams=-, Setting=Zero-shot2025.08 | 93.2 | 79 | 83.5 | — | |
| MSRL-SFTParams=7B, Setting=Zero-shot2025.08 | 93.2 | 73 | 77.6 | — | |
| Qwen3-VL-8B-InstructReinforcement Learning Strategy=RL (Visual-ERM)2026.03 | 92.5 | 74.4 | 84.6 | 79.5 | |
| ChartCoderParams=7B, Setting=Zero-shot2025.08 | 91.4 | 72.5 | 74 | — | |
| GPT-4VParams=-, Setting=Zero-shot2025.08 | 91.2 | 76.4 | 78.9 | — | |
| Qwen3-VL-8B-InstructReinforcement Learning Strategy=RL (DINO-based Reward)2026.03 | 90.8 | 71.1 | 81.9 | 76.5 | |
| VinciCoder-8B-SFTReinforcement Learning Strategy=RL (DINO-based Reward)2026.03 | 90.8 | 73.1 | 82.3 | 77.7 | |
| VinciCoder-8B-SFTModel=VinciCoder-8B-SFT2026.03 | 86.2 | 68.2 | 77.5 | 72.9 | |
| Claude-3-opusParams=-, Setting=Zero-shot2025.08 | 83.3 | 60.5 | 60.1 | — | |
| Qwen3-VL-8B-InstructModel=Qwen3-VL-8B-Instruct2026.03 | 82.2 | 62.7 | 72.7 | 67.7 | |
| JanusCoderV-8BModel=JanusCoderV-8B2026.03 | 80.6 | 65.8 | 73.2 | 69.5 | |
| Qwen2-VL-72BParams=72B, Setting=Zero-shot2025.08 | 73.3 | 54.4 | 50.9 | — | |
| Qwen2.5-VL-7BParams=7B, Setting=Zero-shot2025.08 | 73.2 | 44.6 | 41.6 | — | |
| InternVL2-26BParams=26B, Setting=Zero-shot2025.08 | 69.3 | 41.4 | 47.4 | — | |
| GeminiProVisionParams=-, Setting=Zero-shot2025.08 | 68.2 | 53.8 | 53.3 | — | |
| Qwen2-VL-7BParams=7B, Setting=Zero-shot2025.08 | 67 | 32.9 | 35 | — | |
| InternVL3.5-8BModel=InternVL3.5-8B2026.03 | 62.2 | 41.9 | 48.9 | 45.4 | |
| Chart2CodeParams=7B, Setting=Zero-shot2025.08 | 62.1 | 42.9 | 33.3 | — | |
| InternVL2-8BParams=8B, Setting=Zero-shot2025.08 | 61.8 | 34.4 | 38.9 | — | |
| ChartLlamaParams=13B, Setting=Zero-shot2025.08 | 57.5 | 24.8 | 28.1 | — | |
| TinyChartParams=3B, Setting=Zero-shot2025.08 | 42.5 | 26.3 | 25.9 | — | |
| ChartVLM-LParams=14B, Setting=Zero-shot2025.08 | 19.5 | 15.8 | 13.9 | — |