Hyperparameter Optimization on 108 black-box functions (test) benchmark leaderboard · SOTA2 Research

Hyperparameter Optimization on 108 black-box functions (test)

100.12MeanHEBO

Evaluation Results

Method	Links
HEBO2020.12		100.12	8.7	100.01	100	99.88	98.64	85.71
PySOt2020.12		98.18	9.03	100	99.81	98.6	95.36	80
TURBO2020.12		97.95	10.8	100	99.88	98.75	95.26	78.63
HyperOpt2020.12		96.37	8.79	99.31	98.16	95.94	92.38	78.52
SkOpt2020.12		96.18	11.51	99.78	98.66	96.73	91.62	74.77
TURBO+2020.12		95.29	10.93	98.97	97.6	95.27	90.92	74.77
OpenTuner2020.12		94.32	14.18	98.44	96.93	93.84	89.97	68.96
Nevergrad (1+1)2020.12		93.2	17.52	99.65	97.84	94.57	88.28	55.34
BOHB2020.12		92.03	11.16	96.02	93.55	90.14	85.71	67.82
Random-Search2020.12		92	11.71	96.18	93.55	90.05	85.16	69.55