# Diagram-to-Code on CoSynDiagram

Source: [Diagram-to-Code on CoSynDiagram](<https://www.sota2.com/research/sota/diagram-to-code-on-cosyndiagram>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-08T08:29:12.423Z

Evaluation of model performance on generating code directly from diagrams using the CoSynDiagram dataset, assessed using execution success rate (Exec(%)), visual similarity (Svis), and code similarity (Scode) metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Diagram-to-Code |
| Dataset (including any stated split) | CoSynDiagram |
| Metric | Exec (%) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Exec (%)](<https://www.sota2.com/research/sota/diagram-to-code-on-cosyndiagram.md?metric=Exec%20(%25)>): Higher is better; unit: PERCENT.

- [Visual Similarity (Svis)](<https://www.sota2.com/research/sota/diagram-to-code-on-cosyndiagram.md?metric=Visual%20Similarity%20(Svis)>): Higher is better; unit: PERCENT.

- [Code Similarity (Scode)](<https://www.sota2.com/research/sota/diagram-to-code-on-cosyndiagram.md?metric=Code%20Similarity%20(Scode)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Exec (%) | Result date | Report paper |
| --- | --- | --- | --- |
| OmniDia-7B | 96 | Not recorded | 69d5e0f77d0172140ec75985 |
| OmniDia-3B | 93.7 | Not recorded | 69d5e0f77d0172140ec75985 |
| Qwen2.5-VL-72B | 89.7 | Not recorded | 69d5e0f77d0172140ec75985 |
| OmniDia-7B | 89.5 | Not recorded | 69d5e0f77d0172140ec75985 |
| OmniDia-3B | 87.2 | Not recorded | 69d5e0f77d0172140ec75985 |
| Qwen3-VL-32B | 84.5 | Not recorded | 69d5e0f77d0172140ec75985 |
| Gemini-3-Flash | 83.4 | Not recorded | 69d5e0f77d0172140ec75985 |
| InternVL3.5-14B | 81.8 | Not recorded | 69d5e0f77d0172140ec75985 |
| GPT-5-mini | 76.5 | Not recorded | 69d5e0f77d0172140ec75985 |
| InternVL3.5-8B | 73.1 | Not recorded | 69d5e0f77d0172140ec75985 |
| InternVL3.5-38B | 70.9 | Not recorded | 69d5e0f77d0172140ec75985 |
| InternVL3-8B | 69.7 | Not recorded | 69d5e0f77d0172140ec75985 |
| Qwen2.5-VL-7B | 62.3 | Not recorded | 69d5e0f77d0172140ec75985 |
| Qwen2.5-VL-3B | 47.3 | Not recorded | 69d5e0f77d0172140ec75985 |

### OmniDia-7B

Exec (%): 96. Result ID: 69d611cf47f34ce924be9ec2.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e0f77d0172140ec75985.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e0f77d0172140ec75985.md>)

Recorded evaluation configuration: {"mode":"RL","parameters":"7B"}. This record does not assert independent reproduction.

### OmniDia-3B

Exec (%): 93.7. Result ID: 69d611cf47f34ce924be9ebf.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e0f77d0172140ec75985.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e0f77d0172140ec75985.md>)

Recorded evaluation configuration: {"mode":"RL","parameters":"3B"}. This record does not assert independent reproduction.

### Qwen2.5-VL-72B

Exec (%): 89.7. Result ID: 69d611cf47f34ce924be9ebc.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e0f77d0172140ec75985.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: {"backbone":"Qwen2.5-VL","parameters":"72B"}. This record does not assert independent reproduction.

### OmniDia-7B

Exec (%): 89.5. Result ID: 69d611cf47f34ce924be9ec1.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e0f77d0172140ec75985.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e0f77d0172140ec75985.md>)

Recorded evaluation configuration: {"mode":"SFT","parameters":"7B"}. This record does not assert independent reproduction.

### OmniDia-3B

Exec (%): 87.2. Result ID: 69d611cf47f34ce924be9ebe.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e0f77d0172140ec75985.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e0f77d0172140ec75985.md>)

Recorded evaluation configuration: {"mode":"SFT","parameters":"3B"}. This record does not assert independent reproduction.

### Qwen3-VL-32B

Exec (%): 84.5. Result ID: 69d611cf47f34ce924be9eba.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e0f77d0172140ec75985.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6927db54d6b0dd3342930f66.md>)

Recorded evaluation configuration: {"backbone":"Qwen3-VL","parameters":"32B"}. This record does not assert independent reproduction.

### Gemini-3-Flash

Exec (%): 83.4. Result ID: 69d611cf47f34ce924be9eb6.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e0f77d0172140ec75985.md>)

Recorded evaluation configuration: {"type":"Closed-Source"}. This record does not assert independent reproduction.

### InternVL3.5-14B

Exec (%): 81.8. Result ID: 69d611cf47f34ce924be9eb9.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e0f77d0172140ec75985.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7af01e209131cea85dc9.md>)

Recorded evaluation configuration: {"backbone":"InternVL3.5","parameters":"14B"}. This record does not assert independent reproduction.

### GPT-5-mini

Exec (%): 76.5. Result ID: 69d611cf47f34ce924be9eb5.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e0f77d0172140ec75985.md>)

Recorded evaluation configuration: {"type":"Closed-Source"}. This record does not assert independent reproduction.

### InternVL3.5-8B

Exec (%): 73.1. Result ID: 69d611cf47f34ce924be9eb8.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e0f77d0172140ec75985.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7af01e209131cea85dc9.md>)

Recorded evaluation configuration: {"backbone":"InternVL3.5","parameters":"8B"}. This record does not assert independent reproduction.

### InternVL3.5-38B

Exec (%): 70.9. Result ID: 69d611cf47f34ce924be9ebb.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e0f77d0172140ec75985.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7af01e209131cea85dc9.md>)

Recorded evaluation configuration: {"backbone":"InternVL3.5","parameters":"38B"}. This record does not assert independent reproduction.

### InternVL3-8B

Exec (%): 69.7. Result ID: 69d611cf47f34ce924be9eb7.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e0f77d0172140ec75985.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78241e209131cea76fa5.md>)

Recorded evaluation configuration: {"backbone":"InternVL3","parameters":"8B"}. This record does not assert independent reproduction.

### Qwen2.5-VL-7B

Exec (%): 62.3. Result ID: 69d611cf47f34ce924be9ec0.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e0f77d0172140ec75985.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: {"backbone":"Qwen2.5-VL","parameters":"7B"}. This record does not assert independent reproduction.

### Qwen2.5-VL-3B

Exec (%): 47.3. Result ID: 69d611cf47f34ce924be9ebd.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e0f77d0172140ec75985.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: {"backbone":"Qwen2.5-VL","parameters":"3B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
