Model-Based Optimization on Design-Bench
30.8LogPCOM
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| COMBudget (k)=1, Evaluation Protocol=Oracle Evaluation, Seeds=102024.02 | 30.8 | -3,099 | 0.439 | 1.43 | 6.65 | 0.5 | 0.9 | 0.72 | 5.5 | |
| GABOBudget (k)=1, Evaluation Protocol=Oracle Evaluation, Seeds=102024.02 | 21.3 | -2.6 | 0.57 | 3.6 | 7.51 | 0.67 | 0.71 | 0.6 | 3.8 | |
| BONETBudget (k)=1, Evaluation Protocol=Oracle Evaluation, Seeds=102024.02 | 10.8 | -26.1 | 0.282 | 1.43 | 9.12 | 0.54 | 0.78 | — | 5.7 | |
| AnnealBudget (k)=1, Evaluation Protocol=Oracle Evaluation, Seeds=102024.02 | 8.76 | -9.6 | 0.807 | 1.43 | 5.01 | -1.95 | 0.55 | 0.91 | 6.8 | |
| ROMABudget (k)=1, Evaluation Protocol=Oracle Evaluation, Seeds=102024.02 | 6.37 | -32.7 | 0.433 | 3.37 | 6.66 | 0.5 | 0.35 | -0.7 | 9.4 | |
| CMA-ESBudget (k)=1, Evaluation Protocol=Oracle Evaluation, Seeds=102024.02 | 5.04 | -8.6 | 0.438 | 1.43 | 6.39 | -1.95 | 0.31 | -25 | 10.6 | |
| L-BFGSBudget (k)=1, Evaluation Protocol=Oracle Evaluation, Seeds=102024.02 | 3.82 | -29.6 | 0.527 | 3.51 | 6.48 | -1.95 | 0.31 | 0.73 | 8.5 | |
| BDIBudget (k)=1, Evaluation Protocol=Oracle Evaluation, Seeds=102024.02 | -0.2 | -1,050 | 0.311 | 3.26 | 5.61 | 0.48 | 0.67 | -24.8 | 10.8 | |
| DDOMBudget (k)=1, Evaluation Protocol=Oracle Evaluation, Seeds=102024.02 | -4.23 | -6,677 | 0.46 | 3.74 | 5.56 | 0.63 | 0.51 | -0.32 | 11.1 | |
| Grad.Budget (k)=1, Evaluation Protocol=Oracle Evaluation, Seeds=102024.02 | -5.37 | -245.1 | 0.429 | 3.18 | 6.82 | -1.95 | 0.57 | 0.86 | 9 | |
| BootGenBudget (k)=1, Evaluation Protocol=Oracle Evaluation, Seeds=102024.02 | -13 | — | 0.942 | 1.43 | 8.3 | 0.65 | — | — | 6.2 | |
| ExPTBudget (k)=1, Evaluation Protocol=Oracle Evaluation, Seeds=102024.02 | -15.9 | -57.2 | 0.571 | 3.26 | 6.77 | 0.59 | 0.66 | -34.6 | 9.1 | |
| ROMOBudget (k)=1, Evaluation Protocol=Oracle Evaluation, Seeds=102024.02 | -20.5 | -2,614 | 0.382 | 3.55 | 5.73 | -1.95 | 0.64 | -0.71 | 9.6 | |
| TURBOBudget (k)=1, Evaluation Protocol=Oracle Evaluation, Seeds=102024.02 | -45.1 | -21 | 0.564 | 1.43 | 6.53 | 0.65 | 0.44 | 0.05 | 9 | |
| BOBudget (k)=1, Evaluation Protocol=Oracle Evaluation, Seeds=102024.02 | -52.5 | -11 | 0.586 | 3.64 | 5.65 | 0.59 | 0.61 | 0.16 | 8.8 | |
| GAGABudget (k)=1, Evaluation Protocol=Oracle Evaluation, Seeds=102024.02 | -68.6 | -2.9 | 0.571 | 3.55 | 5.89 | 0.6 | 0.89 | 0.01 | 7.4 |