Chart2Code on ChartMimic
97.5Execution RateMM-ReCoder
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MM-ReCoder# Turns=42026.04 | 97.5 | 86.5 | 84.9 | |
| GPT-4o (reproduced)# Turns=22026.04 | 96.7 | 82.9 | 86.8 | |
| MM-ReCoder# Turns=22026.04 | 96.5 | 84.8 | 84.7 | |
| Qwen3-VL-235B-A22B# Turns=22026.04 | 95.5 | 81.3 | 87.2 | |
| MM-ReCoder-Single# Turns=12026.04 | 95 | 84.3 | 83.7 | |
| GPT-4o (reproduced)# Turns=12026.04 | 94 | 81.8 | 83.7 | |
| GPT-4o# Turns=12026.04 | 93.2 | 79 | 83.5 | |
| Qwen2.5-VL-72B# Turns=22026.04 | 93.2 | 75.9 | 77.6 | |
| Qwen3-VL-235B-A22B# Turns=12026.04 | 93.2 | 80.9 | 85.9 | |
| MM-ReCoder# Turns=12026.04 | 92.5 | 83.5 | 81.2 | |
| ChartCoder# Turns=12026.04 | 91.4 | 77.4 | 74 | |
| GPT-4V# Turns=12026.04 | 91.2 | 76.4 | 78.9 | |
| Qwen2.5-VL-72B# Turns=12026.04 | 89.5 | 72.3 | 74.7 | |
| Qwen3-VL-8B# Turns=22026.04 | 85.5 | 66.6 | 71.1 | |
| Claude-3-opus# Turns=12026.04 | 83.3 | 60.5 | 60.1 | |
| InternVL2-Llama3-76B# Turns=12026.04 | 83.2 | 54.8 | 62.2 | |
| MiniCPM-Llama3-V2.5# Turns=12026.04 | 80.3 | 36.6 | 42.1 | |
| Qwen3-VL-8B# Turns=12026.04 | 74.8 | 65.1 | 66.2 | |
| Qwen2.5-VL-7B# Turns=22026.04 | 74.3 | 57.2 | 50.5 | |
| Qwen2-VL-72B# Turns=12026.04 | 73.3 | 54.4 | 50.9 | |
| Qwen2.5-VL-7B# Turns=12026.04 | 71.5 | 56.2 | 49.6 | |
| InternVL2-26B# Turns=12026.04 | 69.3 | 41.4 | 47.4 | |
| GeminiProVision# Turns=12026.04 | 68.2 | 53.8 | 53.3 | |
| Qwen2-VL-7B# Turns=12026.04 | 67 | 32.9 | 35 | |
| InternVL2-8B# Turns=12026.04 | 61.8 | 34.4 | 38.9 | |
| LLaVA-Next-Mistral-7B# Turns=12026.04 | 59.7 | 20.7 | 21.3 | |
| ChartLlama# Turns=12026.04 | 57.5 | 24.8 | 28.1 | |
| TinyChart# Turns=12026.04 | 42.5 | 26.3 | 25.9 | |
| DeepSeek-VL-7B# Turns=12026.04 | 41.3 | 19 | 17.6 | |
| ChartVLM-L# Turns=12026.04 | 19.5 | 15.8 | 13.9 |