Hyperparameter Optimization on 108 black-box functions (test)
100.12MeanHEBO
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| HEBOrandom_seeds=202020.12 | 100.12 | 8.7 | 100.01 | 100 | 99.88 | 98.64 | 85.71 | |
| PySOtrandom_seeds=202020.12 | 98.18 | 9.03 | 100 | 99.81 | 98.6 | 95.36 | 80 | |
| TURBOrandom_seeds=202020.12 | 97.95 | 10.8 | 100 | 99.88 | 98.75 | 95.26 | 78.63 | |
| HyperOptrandom_seeds=202020.12 | 96.37 | 8.79 | 99.31 | 98.16 | 95.94 | 92.38 | 78.52 | |
| SkOptrandom_seeds=202020.12 | 96.18 | 11.51 | 99.78 | 98.66 | 96.73 | 91.62 | 74.77 | |
| TURBO+random_seeds=202020.12 | 95.29 | 10.93 | 98.97 | 97.6 | 95.27 | 90.92 | 74.77 | |
| OpenTunerrandom_seeds=202020.12 | 94.32 | 14.18 | 98.44 | 96.93 | 93.84 | 89.97 | 68.96 | |
| Nevergrad (1+1)random_seeds=202020.12 | 93.2 | 17.52 | 99.65 | 97.84 | 94.57 | 88.28 | 55.34 | |
| BOHBrandom_seeds=202020.12 | 92.03 | 11.16 | 96.02 | 93.55 | 90.14 | 85.71 | 67.82 | |
| Random-Searchrandom_seeds=202020.12 | 92 | 11.71 | 96.18 | 93.55 | 90.05 | 85.16 | 69.55 |