Hyperparameter Recommendation on LEMUR (evaluation)
0.603RMSECodeLlama-7b-Python-hf
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CodeLlama-7b-Python-hfrecommendations=one-shot, predictions_per_model=35–502025.11 | 0.603 | 0.031 | 0.543 | |
| Optunatrials=>20k2025.11 | 0.636 | 0.002 | 0.633 | |
| DeepSeek-Coder-1.3b-baserecommendations=one-shot, predictions_per_model=35–502025.11 | 0.649 | 0.062 | 0.526 | |
| DeepSeek-R1-Distill-Qwen-7Brecommendations=one-shot, predictions_per_model=35–502025.11 | 0.652 | 0.029 | 0.595 |