Operations Research Autoformalization on IndustryOR
69.1Accuracy (%)AutoOR
Evaluation results
| Method | Links | |
|---|---|---|
| AutoORSize=8B2026.04 | 69.1 | |
| LLMOPTLLM=Qwen1.5-14B, Method Category=fine-tuning LLMs2024.07 | 46 | |
| OptiMUS-0.3LLM=o3, Method Category=agentic frameworks2024.07 | 46 | |
| StandardLLM=o3, Method Category=direct prompting2024.07 | 44 | |
| ORLMSize=8B2026.04 | 42.9 | |
| ORLMLLM=Deepseek-Math, Method Category=fine-tuning LLMs2024.07 | 38 | |
| OptiMUS-0.3LLM=GPT-4o, Method Category=agentic frameworks2024.07 | 37 | |
| Step-OptSize=8B2026.04 | 36.4 | |
| OR-R1RLSize=8B2026.04 | 35.3 | |
| OR-R1SFTSize=8B2026.04 | 33 | |
| StandardLLM=GPT-4o, Method Category=direct prompting2024.07 | 28 |