Visual Reasoning on ARC 2
29.4Solve RateBespoke (Grok-4)
Evaluation results
| Method | Links | |
|---|---|---|
| Bespoke (Grok-4)Params=1.7T2026.06 | 29.4 | |
| Grok-4-thinkingParams=1.7T2026.06 | 16 | |
| L-VARCParams=18M2026.06 | 7.5 | |
| o3-mini-highParams=N/A2026.06 | 3 | |
| GPT-5Params=N/A2026.06 | 1.9 | |
| DeepSeek R1Params=671B2026.06 | 1.3 | |
| Claude 3.7Params=N/A2026.06 | 0.9 |