Diagram coding on Diagram-to-Code
68.89Pass@1DiagramAgent
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DiagramAgentSize=7B2024.11 | 68.89 | 48.99 | 84.64 | |
| GPT-4o2024.11 | 64.07 | 39.95 | 81.78 | |
| GLM-4-plus2024.11 | 51.48 | 35.92 | 80.16 | |
| Deepseek-vlSize=7B2024.11 | 50.74 | 25.18 | 76.48 | |
| Qwen2-VLSize=7B2024.11 | 28.89 | 31.74 | 80.04 | |
| Llama-3.2-VisionSize=11B2024.11 | 27.78 | 21.94 | 75.37 | |
| Phi-3.5-visionSize=4B2024.11 | 24.07 | 27.53 | 76.56 | |
| Gemini-1.5-pro2024.11 | 17.78 | 38.66 | 80.75 | |
| Llava-v1.6Size=34B2024.11 | 8.89 | 26.68 | 76.53 | |
| Cogvlm2-llama3Size=19B2024.11 | 3.7 | 14.42 | 70.72 | |
| Internlm-xcomposer2.5Size=7B2024.11 | 3.33 | 28.47 | 77.35 | |
| Yi-VLSize=34B2024.11 | 2.22 | 20.01 | 70.57 |