Image-to-CAD program synthesis on GenCAD (test)
81.9IoUGIFT
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| GIFTBudget=102026.03 | 81.9 | — | — | — | — | — | — | — | |
| GIFTBudget=92026.03 | 81.8 | — | — | — | — | — | — | — | |
| GIFTBudget=82026.03 | 81.7 | — | — | — | — | — | — | — | |
| GIFTBudget=62026.03 | 81.6 | — | — | — | — | — | — | — | |
| GIFTBudget=72026.03 | 81.6 | — | — | — | — | — | — | — | |
| GIFT-REJECTBudget=102026.03 | 81.2 | — | — | — | — | — | — | — | |
| GIFTBudget=52026.03 | 81.2 | — | — | — | — | — | — | — | |
| GIFTBudget=42026.03 | 81.1 | — | — | — | — | — | — | — | |
| GIFT-REJECTBudget=92026.03 | 81 | — | — | — | — | — | — | — | |
| GIFTBudget=32026.03 | 80.9 | — | — | — | — | — | — | — | |
| SFTBudget=102026.03 | 80.7 | — | — | — | — | — | — | — | |
| GIFT-REJECTBudget=82026.03 | 80.7 | — | — | — | — | — | — | — | |
| GIFT-FAILBudget=102026.03 | 80.6 | — | — | — | — | — | — | — | |
| SFTBudget=92026.03 | 80.4 | — | — | — | — | — | — | — | |
| GIFT-FAILBudget=82026.03 | 80.3 | — | — | — | — | — | — | — | |
| GIFT-FAILBudget=92026.03 | 80.3 | — | — | — | — | — | — | — | |
| GIFT-REJECTBudget=72026.03 | 80.2 | — | — | — | — | — | — | — | |
| GIFT-FAILBudget=62026.03 | 80.2 | — | — | — | — | — | — | — | |
| GIFT-FAILBudget=72026.03 | 80.2 | — | — | — | — | — | — | — | |
| GIFTBudget=22026.03 | 80.2 | — | — | — | — | — | — | — | |
| SFTBudget=82026.03 | 80.1 | — | — | — | — | — | — | — | |
| GIFT-FAILBudget=52026.03 | 79.9 | — | — | — | — | — | — | — | |
| GIFT-REJECTBudget=62026.03 | 79.6 | — | — | — | — | — | — | — | |
| SFTBudget=72026.03 | 79.2 | — | — | — | — | — | — | — | |
| GIFT-FAILBudget=42026.03 | 79.1 | — | — | — | — | — | — | — | |
| GIFT-FAILBudget=32026.03 | 78.9 | — | — | — | — | — | — | — | |
| SFTBudget=62026.03 | 78.8 | — | — | — | — | — | — | — | |
| GIFT-REJECTBudget=52026.03 | 78.5 | — | — | — | — | — | — | — | |
| SFTBudget=52026.03 | 78 | — | — | — | — | — | — | — | |
| GIFT-FAILBudget=22026.03 | 78 | — | — | — | — | — | — | — | |
| GIFTBudget=12026.03 | 77.9 | — | — | — | — | — | — | — | |
| GIFT-REJECTBudget=42026.03 | 77.3 | — | — | — | — | — | — | — | |
| SFTBudget=42026.03 | 76.3 | — | — | — | — | — | — | — | |
| GIFT-REJECTBudget=32026.03 | 76.2 | — | — | — | — | — | — | — | |
| GIFT-FAILBudget=12026.03 | 76.1 | — | — | — | — | — | — | — | |
| GIFT-REJECTBudget=22026.03 | 74.5 | — | — | — | — | — | — | — | |
| SFTBudget=32026.03 | 74.3 | — | — | — | — | — | — | — | |
| GIFT-REJECTBudget=12026.03 | 73.2 | — | — | — | — | — | — | — | |
| SFTBudget=22026.03 | 72.5 | — | — | — | — | — | — | — | |
| SFTBudget=12026.03 | 69.8 | — | — | — | — | — | — | — | |
| CAD-CoderMode=GIFT, Input Res=-2026.03 | — | 78.2 | 94.8 | — | — | — | — | — | |
| Gemini-3-PROMode=Zero-Shot, Input Res=Low2026.03 | — | 20 | 14.1 | — | — | — | — | — | |
| Gemini-3-PROMode=Zero-Shot, Input Res=High2026.03 | — | 54 | 56 | — | — | — | — | — | |
| GIFT2026.03 | — | — | — | 0.777 | 0.812 | 0.82 | 5.2 | -66.4 | |
| GIFT-FAIL2026.03 | — | — | — | 0.761 | 0.792 | 0.806 | 5.9 | -61.9 | |
| GIFT-REJECT2026.03 | — | — | — | 0.732 | 0.788 | 0.812 | 10.9 | -29.6 | |
| SFT2026.03 | — | — | — | 0.698 | 0.776 | 0.807 | 15.5 | — |