Offline Black-Box Optimization on Design-Bench
0.99TFBIND8 ScoreN2CE
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| N2CEQuery budget (Q)=256, Number of runs=52024.05 | 0.99 | 0.803 | 0.661 | 0.567 | 0.982 | 0.961 | 0.827 | 1.2 | |
| Gradient AscentQuery budget (Q)=256, Number of runs=52024.05 | 0.981 | 0.659 | 0.647 | 0.504 | 0.34 | 0.906 | 0.672 | 5 | |
| BONETQuery budget (Q)=256, Number of runs=52024.05 | 0.975 | 0.681 | 0.654 | 0.437 | 0.976 | 0.954 | 0.78 | 3.7 | |
| DDOMQuery budget (Q)=256, Number of runs=52024.05 | 0.971 | 0.688 | 0.633 | 0.56 | 0.957 | 0.926 | 0.787 | 4.5 | |
| COMsQuery budget (Q)=256, Number of runs=52024.05 | 0.964 | 0.654 | 0.648 | 0.423 | 0.949 | 0.948 | 0.764 | 5.8 | |
| REINFORCEQuery budget (Q)=256, Number of runs=52024.05 | 0.959 | 0.64 | 0.636 | 0.481 | 0.261 | 0.474 | 0.575 | 8.3 | |
| CbASQuery budget (Q)=256, Number of runs=52024.05 | 0.958 | 0.657 | 0.64 | 0.45 | 0.876 | 0.896 | 0.746 | 7.3 | |
| MINsQuery budget (Q)=256, Number of runs=52024.05 | 0.938 | 0.659 | 0.653 | 0.484 | 0.942 | 0.944 | 0.77 | 5.5 | |
| CMA-ESQuery budget (Q)=256, Number of runs=52024.05 | 0.933 | 0.679 | 0.636 | 0.491 | 1.436 | 0.725 | 0.816 | 5.8 | |
| GP-qEIQuery budget (Q)=256, Number of runs=52024.05 | 0.824 | 0.635 | 0.633 | 0.501 | 0.887 | 0.896 | 0.729 | 7.8 | |
| D (best)Query budget (Q)=256, Number of runs=52024.05 | 0.439 | 0.467 | 0.605 | 0.399 | 0.565 | 0.884 | — | — |