Linear Programming Problem Solving on NL4OPT (test)
93SALLMOPT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LLMOPTBase LLM=Qwen1.5-14B2026.05 | 93 | 3.07 | |
| OptiMUS0.3Base LLM=GPT-4o2026.05 | 86.6 | — | |
| ORLMBase LLM=Deepseek-Math2026.05 | 86.5 | — | |
| ORLMBase LLM=LLaMa3-8B2026.05 | 85.7 | — | |
| ORPilotBase LLM=Deepseek-Reasoner, Solver Backend=pulp2026.05 | 76.6 | 235.1 | |
| ORPilotBase LLM=Claude Snonnet 4.6, Solver Backend=pulp2026.05 | 73.2 | 16.3 | |
| ORPilotBase LLM=GPT-4o, Solver Backend=pulp2026.05 | 71 | 15.3 |