CadQuery code generation on Recap-OmniCAD+-2K
49.7IRQwen2.5
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Qwen2.5version=72B2026.03 | 49.7 | 29.54 | 2.33 | |
| Claudeversion=Opus2026.03 | 41.75 | 31.03 | 8.61 | |
| Geminiversion=1.5 Pro2026.03 | 39.25 | 14.94 | 0.82 | |
| GPTversion=4o2026.03 | 33.55 | 35.08 | 10.74 | |
| Pointer-CADversion=0.5B2026.03 | 26.02 | 5.43 | 0.53 | |
| Pointer-CADversion=1.5B2026.03 | 19.11 | 2.92 | 0.35 |