Combinatorial Optimization on Crew Scheduling (test)
63.53Average PerformanceMCTS-AHD
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MCTS-AHDBudget=B=162026.05 | 63.53 | 86.21 | |
| MEMOIR (GPT-5-mini w/ GPT-5 critic)Budget=B=162026.05 | 62.4 | 89.66 | |
| MEMOIR (GPT-5-mini)Budget=B=162026.05 | 57.83 | 75.86 | |
| GPT-5-miniBudget=B=162026.05 | 57.35 | 65.52 | |
| AIDEBudget=B=162026.05 | 56 | 72.41 | |
| FunSearchBudget=B=162026.05 | 55.64 | 62.07 | |
| GreedyRefineBudget=B=162026.05 | 55.45 | 62.07 | |
| ReEvoBudget=B=162026.05 | 52.74 | 65.52 | |
| GPT-5 ChatBudget=B=162026.05 | 51.65 | 75.86 | |
| Classical SolverBudget=B=162026.05 | 45.5 | — | |
| o3-mini-highBudget=B=162026.05 | 44.12 | 65.52 | |
| MEMOIR (Qwen2.5-Coder-32B)Budget=B=162026.05 | 31.55 | 55 |