Hyperparameter Optimization on LCBench (test)
0.6433ScoreGPT4-o3-mini
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| GPT4-o3-miniBackbone=GPT4-o3-mini2025.11 | 0.6433 | 0.2259 | 0.3168 | 0.3961 | 0.9989 | 85.71 | 1 | |
| Qwen2.5-7bBackbone=Qwen2.5-7b2025.11 | 0.5562 | 0.2154 | 0.4805 | 0.3945 | 0.9957 | 78.57 | 2 | |
| LLM-ESSolver=SelfAI with Evolutionary Strategy2025.11 | 0.5294 | 0.2349 | 0.4691 | 0.4582 | 0.9981 | 64.29 | 3 | |
| GPT4-o3Backbone=GPT4-o32025.11 | 0.514 | 0.2284 | 0.5477 | 0.3961 | 0.9966 | 64.29 | 4 | |
| Qwen2.5-14bBackbone=Qwen2.5-14b2025.11 | 0.5015 | 0.331 | 0.4926 | 0.4997 | 0.9969 | 78.57 | 5 | |
| DeepSeek-r1-32bBackbone=DeepSeek-r1-32b2025.11 | 0.4989 | 0.3476 | 0.4535 | 0.5433 | 0.9933 | 78.57 | 6 | |
| DeepSeek-r1-14bBackbone=DeepSeek-r1-14b2025.11 | 0.4793 | 0.3956 | 0.4953 | 0.51 | 0.9948 | 71.43 | 7 | |
| DeepSeek-r1-7bBackbone=DeepSeek-r1-7b2025.11 | 0.4769 | 0.1802 | 0.702 | 0.3093 | 0.9927 | 50 | 8 | |
| DeepSeek-r1-70bBackbone=DeepSeek-r1-70b2025.11 | 0.4556 | 0.3513 | 0.5392 | 0.5299 | 0.9962 | 71.43 | 9 | |
| Qwen2.5-32bBackbone=Qwen2.5-32b2025.11 | 0.4287 | 0.4684 | 0.5252 | 0.6133 | 0.9972 | 78.57 | 10 | |
| Qwen2.5-72bBackbone=Qwen2.5-72b2025.11 | 0.4189 | 0.5358 | 0.4531 | 0.7087 | 0.9995 | 85.71 | 11 | |
| Llama3.3-70bBackbone=Llama3.3-70b2025.11 | 0.3625 | 0.5483 | 0.5099 | 0.7271 | 0.9683 | 71.43 | 12 | |
| LLMSolver=Generic LLM Baseline2025.11 | 0.3526 | 0.7638 | 0.2949 | 1 | 1 | 92.86 | 13 | |
| GSSolver=Grid Search2025.11 | 0.2453 | 1 | 0.5094 | 1 | 1 | 100 | 14 | |
| BSSolver=Bayesian Search2025.11 | 0.1927 | 0.8106 | 0.6265 | 0.9881 | 1 | 100 | 15 |