Optimization Modeling on MAMO Complex
67.9AccuracyDeepSeek-R1
Evaluation Results
| Method | Links | |
|---|---|---|
| DeepSeek-R1Method Category=Model-based Methods2026.06 | 67.9 | |
| DeepSeek-V3.1Method Category=Model-based Methods2026.06 | 63.5 | |
| StarORMethod Category=Test-Time Methods, Base model=Qwen3-4B-Instruct-25072026.06 | 54.2 | |
| SIRL-Qwen2.5-7BMethod Category=Learning-based Methods2026.06 | 51.7 | |
| OpenAI-o3Method Category=Model-based Methods2026.06 | 51.2 | |
| OptMATH-Qwen2.5-7BMethod Category=Learning-based Methods2026.06 | 51.2 | |
| OR-R1-Qwen3-8BMethod Category=Test-Time Methods, Base model=Qwen3-4B-Instruct-25072026.06 | 49.9 | |
| GPT-4Method Category=Model-based Methods2026.06 | 49.3 | |
| LLMOPT-Qwen2.5-14BMethod Category=Learning-based Methods2026.06 | 44.1 | |
| ORLM-LLaMA3-8BMethod Category=Learning-based Methods2026.06 | 37.4 | |
| OptiTreeMethod Category=Test-Time Methods, Base model=Qwen3-4B-Instruct-25072026.06 | 32.2 | |
| AutoFormulatorMethod Category=Test-Time Methods, Base model=Qwen3-4B-Instruct-25072026.06 | 23.1 | |
| Best-of-NMethod Category=Test-Time Methods, Base model=Qwen3-4B-Instruct-2507, N=162026.06 | 22.2 | |
| ReflexionMethod Category=Test-Time Methods, Base model=Qwen3-4B-Instruct-25072026.06 | 16.3 | |
| Zero-shotMethod Category=Test-Time Methods, Base model=Qwen3-4B-Instruct-25072026.06 | 11.8 |