Mathematical Optimization Modeling on NL4COP
87.3AccuracyTriVAL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TriVALModel=DeepSeek-V3.2, Method category=Prompt-based2026.05 | 87.3 | 88.8 | |
| TriVALModel=GPT-5.1, Method category=Prompt-based2026.05 | 81.3 | 86.9 | |
| OR-LLM-AgentModel=GPT-5.1, Method category=Prompt-based2026.05 | 68 | 81.8 | |
| OptiTreeModel=GPT-5.1, Method category=Prompt-based2026.05 | 56 | 74.1 | |
| OptiTreeModel=DeepSeek-V3.2, Method category=Prompt-based2026.05 | 54.7 | 71.2 | |
| OR-LLM-AgentModel=DeepSeek-V3.2, Method category=Prompt-based2026.05 | 52 | 76.8 | |
| SIRLMethod category=Learning-based2026.05 | 28 | 54.9 | |
| AutoFormulationModel=GPT-5.1, Method category=Prompt-based2026.05 | 25.3 | 52.1 | |
| AutoFormulationModel=DeepSeek-V3.2, Method category=Prompt-based2026.05 | 14.7 | 50.1 | |
| ORLMMethod category=Learning-based2026.05 | 11.3 | 29.1 | |
| LLMOPTMethod category=Learning-based2026.05 | 10.7 | 31.9 |