CAD command prediction on DeepCAD
96.6Avg Command AccuracyTCADGen + CADLLM
Evaluation Results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| TCADGen + CADLLMCADLLM augmentation=true2025.05 | 96.6 | 94.7 | 96.2 | 95.7 | 97.9 | 92.5 | 92.4 | 95.9 | 96 | 94.2 | 94.6 | |
| TCADGen2025.05 | 89 | 77.1 | 85.4 | 80.8 | 95 | 68.2 | 64.2 | 83.7 | 77.1 | 78.1 | 74.6 | |
| TCADGen (Ablation)Component=Dual-channel only, BERT fine-tuning=false2025.05 | 84.7 | 76.9 | 85 | 79.1 | 94.5 | 66.8 | 52.3 | 80.2 | 76.2 | 74.6 | 68.4 | |
| Text2CAD2025.05 | 84 | 72.2 | 81.9 | 76.3 | 90.4 | 58.4 | 60.1 | 75.1 | 70.1 | 77.2 | 70.5 | |
| TCADGen (Ablation)Component=BERT fine-tuned only, Dual-channel=false2025.05 | 80.7 | 73.1 | 82.8 | 76 | 93.7 | 63.7 | 69 | 75.7 | 69 | 71.1 | 62.2 | |
| DeepCAD2025.05 | 57.1 | 60.6 | 74.7 | 64.8 | 79.7 | 54 | 58.8 | 58.7 | 55.1 | 61.6 | 61.5 |