CAD Generation on OmniCAD-Plan (test)
91.25RMR@3Pointer-CAD v2
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Pointer-CAD v2Number of Parameters=1.5B2026.06 | 91.25 | 92.76 | 90.33 | 89.65 | 94.23 | 68.53 | 89.18 | 88.73 | 91.14 | |
| Pointer-CAD v2Model size=1.5B2026.06 | 90.89 | 92.18 | 89.26 | 88.21 | 93.6 | 67.12 | 87.93 | 87.57 | 89.37 | |
| Pointer-CAD v2Model size=0.5B2026.06 | 87.77 | 89.24 | 84.34 | 82.17 | 92.61 | 56.16 | 83.19 | 81.88 | 88.44 | |
| Pointer-CAD v2Number of Parameters=0.5B2026.06 | 87.29 | 90.1 | 86.4 | 85.19 | 92.21 | 64.54 | 84.85 | 83.89 | 89.05 | |
| CADmiumNumber of Parameters=1.5B2026.06 | 81.15 | 79.36 | 78.25 | 80.58 | 74.03 | 5.61 | 74.19 | 75.56 | 67.99 | |
| CADmiumNumber of Parameters=0.5B2026.06 | 78.6 | 76.37 | 74.34 | 76.05 | 72.41 | 4.55 | 70.57 | 71.47 | 66.56 | |
| Gemini 3 Pro2026.06 | 74.65 | 68.93 | 69.51 | 68.96 | 73.12 | 39.73 | 67.02 | 67.54 | 64.93 | |
| Pointer-CADNumber of Parameters=1.5B2026.06 | 72.1 | 64.67 | 62.35 | 62.89 | 62.4 | 24.83 | 61.69 | 62.19 | 59.5 | |
| GPT-5.22026.06 | 69.16 | 61.03 | 63.55 | 63.11 | 66.59 | 38.36 | 60.52 | 61.41 | 56.94 | |
| Pointer-CADNumber of Parameters=0.5B2026.06 | 66.03 | 58.87 | 54.81 | 54.3 | 59.18 | 7.34 | 54.7 | 54.44 | 55.88 | |
| Claude Opus 4.52026.06 | 61.34 | 55.41 | 52.77 | 49.21 | 65.86 | 30 | 52.31 | 51.09 | 57.21 | |
| Qwen3-235B-A22BModel size=235B-A22B2026.06 | 58.34 | 53.28 | 49.62 | 48.09 | 56.03 | 30.14 | 46.75 | 46.95 | 45.93 |