Hartmann
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Hartmann 6D
0.63Normalized RMSE
16
Hartmann 3D
0.26Normalized RMSE
16
Hartmann3
0.51Average CPU Time (s)
13
Hartmann Complicated
75.35Final Cumulative Expected Regret
9
Hartmann
63.18Cumulative Regret
9
Hartmann
0.027Simple Regret (x10^-2)
9
Hartmann d=6 synthetic (round 10)
6Relative Batch Instantaneous Regret
9
Hartmann d=6
0.32Relative Batch Instantaneous Regret
8
Hartmann 6D
0.19Time per Iteration (s)
7
Hartmann 6 (D=6, T=64)
26Stopping Time
6
Hartmann 3 D=3, T=64
14Stopping Time
6
Hartmann3 d+1=3
0.26Average Regret
6
Rand. Hartmann6 (meta-test)
0.044Calibration Error
6
Hartmann
3.863Best Observed Value
5
Hartmann Dim 6
27AUC
5
Hartmann Dim 3
68AUC
5
Hartmann 6D (500 evaluations)
2.619Mean Objective Value
4
Hartmann 300 evaluations 6D
2.857Mean Objective Value
4
Hartmann 6-D
0.389Simple Regret
3
Hartmann-6D
2.74Final Best Performance
3
Embedded Hartmann 6 (d=100)
0.035Relative Batch Instantaneous Regret
3
Hartmann 6D (test)
0.37Runtime (s)
2