Optimization Modeling on MAMO Easy
94.4AccuracyStarOR
Evaluation Results
| Method | Links | |
|---|---|---|
| StarORMethod Category=Test-Time Methods, Base model=Qwen3-4B-Instruct-25072026.06 | 94.4 | |
| SIRL-Qwen2.5-7BMethod Category=Learning-based Methods2026.06 | 91.7 | |
| OptiTreeMethod Category=Test-Time Methods, Base model=Qwen3-4B-Instruct-25072026.06 | 90 | |
| LLMOPT-Qwen2.5-14BMethod Category=Learning-based Methods2026.06 | 89.5 | |
| DeepSeek-V3.1Method Category=Model-based Methods2026.06 | 88.9 | |
| Best-of-NMethod Category=Test-Time Methods, Base model=Qwen3-4B-Instruct-2507, N=162026.06 | 88.9 | |
| GPT-4Method Category=Model-based Methods2026.06 | 87.3 | |
| DeepSeek-R1Method Category=Model-based Methods2026.06 | 87.2 | |
| OptMATH-Qwen2.5-7BMethod Category=Learning-based Methods2026.06 | 86.5 | |
| OR-R1-Qwen3-8BMethod Category=Test-Time Methods, Base model=Qwen3-4B-Instruct-25072026.06 | 86.1 | |
| AutoFormulatorMethod Category=Test-Time Methods, Base model=Qwen3-4B-Instruct-25072026.06 | 85.7 | |
| ReflexionMethod Category=Test-Time Methods, Base model=Qwen3-4B-Instruct-25072026.06 | 82.7 | |
| ORLM-LLaMA3-8BMethod Category=Learning-based Methods2026.06 | 82.3 | |
| Zero-shotMethod Category=Test-Time Methods, Base model=Qwen3-4B-Instruct-25072026.06 | 81.9 | |
| OpenAI-o3Method Category=Model-based Methods2026.06 | 77.1 |