List your company
ResearchFormerly WizWand

Optimization Modeling and Solving on NLP4LP

89.02SA ScoreORThought
12.340832.247952.15572.0621Jun 24, 2026Jun 26, 2026Jun 28, 2026Jun 30, 2026Jul 2, 2026Jul 4, 2026Jul 6, 2026
Updated 3mo ago

Evaluation results

MethodLinks
ORThought2026.0789.02
OptiAgentBackbone=GPT 5.42026.0787.12
LLMOPT2026.0783.8
GPT 5.2System Prompt=with2026.0783.46
Sonnet 4.5System Prompt=with2026.0781.82
GPT 5.4System Prompt=with2026.0781.61
NEMO2026.0781.4
GPT 5.4System Prompt=without2026.0780.46
DeepSeek-V3 (671B)Category=General Models, Avg.=60.14, Rank=32026.0679.34
SonnetSystem Prompt=without2026.0778.41
DeepSeek-R1System Prompt=with2026.0776.89
OptiAgentBackbone=Sonnet 4.52026.0776.14
CoE2026.0775
MiniOpt-7BCategory=Ours, Avg.=64.76, Rank=1, Rank*=12026.0674.79
MiniOpt-3BCategory=Ours, Avg.=59.65, Rank=5, Rank*=22026.0674.38
GPT 5.2System Prompt=without2026.0774.24
Gemini-2.5-ProCategory=General Models (Thinking), Avg.=57.39, Rank=72026.0673.55
LLMOPT-14BCategory=Learning-based Models, Avg.=60.10, Rank=42026.0673.42
GPT-5Category=General Models (Thinking), Avg.=57.54, Rank=62026.0673.14
DeepSeek-R1 (671B)Category=General Models (Thinking), Avg.=60.85, Rank=22026.0669.83
OptMATH-7BCategory=Learning-based Models, Avg.=54.62, Rank=8, Rank*=32026.0668.6
ORLM2026.0767.8
Qwen2.5-14B-InstructCategory=General Models, Avg.=47.46, Rank=102026.0667.36
DeepSeekSystem Prompt=without2026.0764.02
Chain-of-ExpertsCategory=Prompt-based Methods, Avg.=45.78, Rank=112026.0659.09
Qwen2.5-7B-InstructCategory=General Models, Avg.=33.20, Rank=14, Rank*=62026.0655.37
ReflexionCategory=Prompt-based Methods, Avg.=45.54, Rank=122026.0653.72
Step-OPT-Qwen2.5-3BCategory=Learning-based Models, Avg.=39.76, Rank=13, Rank*=52026.0653.31
Step-OPT-Qwen2.5-7BCategory=Learning-based Models, Avg.=52.22, Rank=9, Rank*=42026.0648.35
Qwen3-8BCategory=General Models (Thinking), Avg.=21.79, Rank=16, Rank*=72026.0634.71
Qwen3-14BCategory=General Models (Thinking), Avg.=23.78, Rank=152026.0619.42
Qwen2.5-3B-InstructCategory=General Models, Avg.=11.23, Rank=18, Rank*=92026.0618.6
OptiMUSCategory=Prompt-based Methods, Avg.=20.65, Rank=172026.0618.18
Qwen3-4BCategory=General Models (Thinking), Avg.=11.16, Rank=19, Rank*=82026.0615.29