Combinatorial Optimization on Periodic Vehicle Routing (test)
0.869Average ValueMEMOIR (GPT-5-mini w/ GPT-5 critic)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MEMOIR (GPT-5-mini w/ GPT-5 critic)Budget=B=162026.05 | 0.869 | 100 | |
| MEMOIR (GPT-5-mini)Budget=B=162026.05 | 0.7642 | 80 | |
| FunSearchBudget=B=162026.05 | 0.7178 | 80 | |
| GreedyRefineBudget=B=162026.05 | 0.378 | 40 | |
| ReEvoBudget=B=162026.05 | 0.313 | 40 | |
| MCTS-AHDBudget=B=162026.05 | 0.299 | 40 | |
| MEMOIR (Llama-3.3-70B-Instruct)Budget=B=162026.05 | 0.1468 | 40 | |
| GPT-5-miniBudget=B=162026.05 | 0.135 | 20 | |
| Classical SolverBudget=B=162026.05 | 0.1244 | — | |
| AIDEBudget=B=162026.05 | 0.1058 | 20 | |
| Llama-3.3-70B-InstructBudget=B=162026.05 | 0 | 0 | |
| Qwen2.5-Coder-32BBudget=B=162026.05 | 0 | 0 | |
| GPT-5 ChatBudget=B=162026.05 | 0 | 0 | |
| o3-mini-highBudget=B=162026.05 | 0 | 0 |