Offline Black-Box Optimization on Overall Task Suite (SuperC, Ant, D’Kitty, LLM-DM, TF8, TF10)
1.7Mean RankSPADE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SPADECandidates (K)=128, Random seeds=82026.05 | 1.7 | 1 | |
| DEMOCandidates (K)=128, Random seeds=82026.05 | 5.5 | 5.5 | |
| ROOTCandidates (K)=128, Random seeds=82026.05 | 6.2 | 5 | |
| RGDCandidates (K)=128, Random seeds=82026.05 | 7.3 | 8 | |
| MATCH-OPTCandidates (K)=128, Random seeds=82026.05 | 8.2 | 7.5 | |
| LTRCandidates (K)=128, Random seeds=82026.05 | 9 | 8.5 | |
| BONETCandidates (K)=128, Random seeds=82026.05 | 9.3 | 11 | |
| ICTCandidates (K)=128, Random seeds=82026.05 | 10.5 | 10 | |
| Tri-mentoringCandidates (K)=128, Random seeds=82026.05 | 11.5 | 11.5 | |
| GTGCandidates (K)=128, Random seeds=82026.05 | 11.5 | 10 | |
| GA on GPCandidates (K)=128, Random seeds=82026.05 | 12.8 | 13.5 | |
| BDICandidates (K)=128, Random seeds=82026.05 | 12.8 | 16 | |
| RoMACandidates (K)=128, Random seeds=82026.05 | 13.2 | 13 | |
| MINsCandidates (K)=128, Random seeds=82026.05 | 13.2 | 12.5 | |
| MC-DropoutCandidates (K)=128, Random seeds=82026.05 | 13.3 | 13 | |
| Standard GACandidates (K)=128, Random seeds=82026.05 | 13.5 | 15.5 | |
| BO-qEICandidates (K)=128, Random seeds=82026.05 | 15.5 | 16 | |
| DDOMCandidates (K)=128, Random seeds=82026.05 | 16 | 18 | |
| PGSCandidates (K)=128, Random seeds=82026.05 | 16.7 | 19.5 | |
| CMA-ESCandidates (K)=128, Random seeds=82026.05 | 16.8 | 15.5 | |
| REINFORCECandidates (K)=128, Random seeds=82026.05 | 17.2 | 19.5 | |
| COMsCandidates (K)=128, Random seeds=82026.05 | 17.5 | 18 | |
| GABOCandidates (K)=128, Random seeds=82026.05 | 19.5 | 20 | |
| CbASCandidates (K)=128, Random seeds=82026.05 | 20.2 | 21 |