Constraint Modeling on Text2Zinc
7.69NLP4LP Execution Accuracy (Eacc)OptiMind (Chain-of-Thought)
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| OptiMind (Chain-of-Thought)Co-Pilot Strategy=Chain-of-Thought (CoT), LLM Calls=12026.04 | 7.69 | 3.08 | 0 | 0 | 20 | 20 | 9.09 | 0 | 4.55 | 4.55 | 7.27 | 3.64 | |
| OptiMind (Zero Shot)Co-Pilot Strategy=Zero Shot, LLM Calls=12026.04 | 3.08 | 0 | 0 | 0 | 0 | 0 | 18.18 | 9.09 | 4.55 | 0 | 4.55 | 0.91 |