VRP optimization-modeling on VRP Optimization-Modeling Benchmark 1
96.13Pass@1VRPCoder-GRPO
Evaluation Results
| Method | Links | |
|---|---|---|
| VRPCoder-GRPOModel scale=8B, Stage=GRPO2026.06 | 96.13 | |
| Gemini-3.1-Pro PreviewModel type=Closed-source frontier LLM2026.06 | 95.81 | |
| VRPCoder-SFTModel scale=8B, Stage=SFT2026.06 | 92.26 | |
| Claude-Sonnet-4.5Model type=Closed-source frontier LLM2026.06 | 70.65 | |
| DeepSeek-V3.2Model type=Open-source general-purpose LLM2026.06 | 31.29 | |
| MiniMax-M2.5Model type=Open-source general-purpose LLM2026.06 | 21.61 | |
| Qwen2.5-72B-InstructModel type=Open-source general-purpose LLM2026.06 | 15.81 | |
| SIRL-Gurobi-32BModel type=OR-LLM2026.06 | 8.71 | |
| ORLM-LLaMA-3-8BModel type=OR-LLM2026.06 | 3.87 | |
| SIRL-Gurobi-8BModel type=OR-LLM2026.06 | 1.94 | |
| OptMATH-Qwen2.5-7BModel type=OR-LLM2026.06 | 0.97 | |
| Qwen3-8BModel type=Open-source general-purpose LLM2026.06 | 0 |