Geometric Interleaved Reasoning on GGBench
39.11VLM-I Final ScoreGPT-image-1
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| GPT-image-1Architecture Category=End-to-end UMMs2026.03 | 39.11 | — | — | 50.67 | 16.95 | 64.37 | 39.11 | |
| GPT-5Architecture Category=LLMs/LRMs2026.03 | 37.36 | 62.01 | 76.79 | 49.65 | 54.8 | 59.49 | 57.08 | |
| FaireArchitecture Category=LLMs/LRMs2026.03 | 37.14 | 60.13 | 89.11 | 33.31 | 20.36 | 75.57 | 63.13 | |
| Claude Sonnet 4.5Architecture Category=LLMs/LRMs2026.03 | 30.29 | 61.19 | 77.92 | 52.22 | 51.74 | 50.52 | 54.11 | |
| DeepSeek-V3.1Architecture Category=LLMs/LRMs2026.03 | 26.41 | 60.24 | 73.13 | 57.21 | 48.33 | 50.12 | 49.77 | |
| Qwen3-VLArchitecture Category=LLMs/LRMs2026.03 | 23.94 | 56.4 | 49.55 | 39.4 | 52.33 | 58.71 | 36.74 | |
| Nano BananaArchitecture Category=End-to-end UMMs2026.03 | 22.81 | 58.54 | 44.83 | 51.85 | 64.53 | 59.51 | 33.82 | |
| Qwen-ImageArchitecture Category=End-to-end UMMs2026.03 | 22.75 | — | — | 56.39 | 58.23 | 48.06 | 22.75 | |
| DeepSeek-R1Architecture Category=LLMs/LRMs2026.03 | 20.48 | 61.16 | 62.42 | 66.06 | 37.94 | 37.59 | 41.45 | |
| GPT-4Architecture Category=LLMs/LRMs2026.03 | 20.3 | 55.66 | 50.39 | 67.35 | 35.26 | 38.31 | 33.04 | |
| JanusArchitecture Category=End-to-end UMMs2026.03 | 19.76 | 33.85 | 21.69 | 57.74 | 57.76 | 60.97 | 20.73 | |
| Gemini 2.5 ProArchitecture Category=LLMs/LRMs2026.03 | 15.8 | 38.5 | 37.41 | 68.39 | 37.17 | 39.73 | 26.61 | |
| Qwen3-14BArchitecture Category=LLMs/LRMs2026.03 | 12.97 | 58.65 | 39.3 | 78.81 | 23.92 | 24.81 | 26.13 | |
| GLM-4.5VArchitecture Category=LLMs/LRMs2026.03 | 5.02 | 53.32 | 25.63 | 52.91 | 12.19 | 12.94 | 15.33 | |
| GPT-4oArchitecture Category=LLMs/LRMs2026.03 | 2.66 | 59.73 | 26.19 | 95.43 | 5.45 | 5.69 | 14.43 |