Visual Reasoning on TIR-Bench
51.8Average ScoreInterSketch-8B
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| InterSketch-8BParameter Scale=8B2026.05 | 51.8 | 85 | 52 | 71 | 21.2 | 75 | 97.3 | 59.2 | 28.4 | 63.3 | 42 | 32 | |
| Gemini-3-ProModel Type=Proprietary2026.05 | 49 | 70.8 | 49 | 43 | 21 | 33.3 | 58.3 | 55 | 29.9 | 65.8 | 64 | 66 | |
| o3-TUModel Type=Proprietary2026.05 | 46 | 42.5 | 55 | 64 | 16.4 | 53.3 | 77.3 | 31.7 | 41 | 57.5 | 66 | 42 | |
| GPT-5Model Type=Proprietary2026.05 | 30.7 | 50.8 | 45 | 5 | 8.8 | 11.7 | 34.7 | 32.5 | 34.9 | 42.5 | 28 | 40 | |
| Gemini-2.5-ProModel Type=Proprietary2026.05 | 29 | 24.2 | 44 | 12 | 10.4 | 25 | 30.7 | 21.7 | 28.5 | 58.3 | 34 | 42 | |
| Qwen3-VL-32BModel Type=Open-source, Parameter Scale=32B2026.05 | 26.5 | 25.8 | 35 | 11 | 3.4 | 53 | 17.3 | 21.7 | 23.5 | 59.2 | 12 | 32 | |
| Qwen3-VL-235BModel Type=Open-source, Parameter Scale=235B2026.05 | 24.3 | 13.3 | 34 | 14 | 6.8 | 65 | 14.7 | 17.5 | 19.9 | 54.2 | 16 | 38 | |
| Qwen3-VL-8BModel Type=Open-source, Parameter Scale=8B2026.05 | 22.3 | 27.5 | 31 | 4 | 4.8 | 48.3 | 20 | 10 | 13.7 | 55.8 | 16 | 28 | |
| Thyme-7BModel Type=Open-source, Parameter Scale=7B2026.05 | 20.8 | 22.5 | 29 | 0 | 4.6 | 50 | 13.3 | 6.5 | 12.9 | 54.2 | 42.9 | 16 | |
| GPT-4.1Model Type=Proprietary2026.05 | 19.8 | 25 | 36 | 2 | 5 | 16.6 | 20 | 15 | 20.6 | 36.7 | 24 | 24 | |
| InternVL3.5-38BModel Type=Open-source, Parameter Scale=38B2026.05 | 18.3 | 11.7 | 31 | 11 | 3.7 | 3.3 | 17.3 | 17.5 | 11 | 35 | 26 | 34 | |
| DeepEyes-7BModel Type=Open-source, Parameter Scale=7B2026.05 | 17.8 | 16.7 | 22 | 1 | 3.9 | 41.7 | 12 | 6.7 | 19.9 | 50.8 | 19.9 | 16 | |
| InternVL3.5-8BModel Type=Open-source, Parameter Scale=8B2026.05 | 17.3 | 17.5 | 25 | 7 | 4.8 | 1.7 | 9.3 | 22.5 | 17.3 | 32.5 | 22 | 26 | |
| GPT-4oModel Type=Proprietary2026.05 | 17.3 | 20 | 26 | 0 | 6.2 | 10 | 20 | 22.5 | 19.4 | 35 | 10 | 26 | |
| InternVL3-8BModel Type=Open-source, Parameter Scale=8B2026.05 | 16.9 | 33.3 | 23 | 2 | 4.5 | 0 | 17.3 | 11.7 | 16.6 | 36.7 | 6 | 22 |