Text-to-model translation on IndustryOR Text2Zinc
92Execution Accuracy (Eacc)CoT + Grammar
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CoT + GrammarLLM Calls=22026.04 | 92 | 56 | |
| CoT + Code & GrammarLLM Calls=32026.04 | 92 | 55 | |
| CoT + Code ValidationLLM Calls=22026.04 | 86 | 49 | |
| Agentic + CodeLLM Calls=52026.04 | 86 | 57 | |
| Chain-of-Thought (CoT)LLM Calls=12026.04 | 80 | 49 | |
| GalaLLM Calls=52026.04 | 77 | 52 | |
| AgenticLLM Calls=42026.04 | 74 | 48 | |
| Zero ShotLLM Calls=12026.04 | 66 | 46 |