Operations Research Modeling and Solving on OR-llm-Agent
81.93Accuracy (pass@1)NEDTree
Evaluation results
| Method | Links | |
|---|---|---|
| NEDTreeType=Context-based2026.04 | 81.93 | |
| ORllmAgentType=Prompt-based2026.04 | 74.7 | |
| GPT-o4-miniType=Reasoning2026.04 | 72.29 | |
| Deepseek-R1Type=Reasoning2026.04 | 68.67 | |
| Chain-of-ExpertsType=Prompt-based2026.04 | 67.47 | |
| Deepseek-V3Type=Non-reasoning2026.04 | 61.44 | |
| OptimusType=Prompt-based2026.04 | 48.19 | |
| GPT-4oType=Non-reasoning2026.04 | 40.96 | |
| LLMOPTType=Fine-tuning2026.04 | 13.25 | |
| ORLM(best)Type=Fine-tuning2026.04 | 12.05 |