FEA Code Generation on Abaqus FEA Tasks (Stage-B)
100Execution Preflight CheckVFEAgent
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| VFEAgent2026.05 | 100 | 100 | 100 | 100 | 100 | 100 | |
| Qwen-3-Max2026.05 | 50 | 100 | 100 | 69 | 37 | 53 | |
| Grok-42026.05 | 50 | 100 | 100 | 69 | 37 | 53 | |
| Gemini-3-Pro2026.05 | 25 | 50 | 100 | 38 | 30 | 34 | |
| GPT-52026.05 | 0 | 100 | 75 | 81 | 39 | 60 |