Hyperparameter Optimization on JAHS-C10 Bench (val)
8.07Validation ErrorπBO
Evaluation results
| Method | Links | |
|---|---|---|
| πBOBudget=20x, Prior Quality=Near Optimum2023.06 | 8.07 | |
| πBOBudget=10x, Prior Quality=Near Optimum2023.06 | 8.23 | |
| PriorBandBudget Horizon=12x, Prior Quality=Near Optimum2023.06 | 8.236 | |
| PriorBand+BOBudget=20x, Prior Quality=Near Optimum2023.06 | 8.248 | |
| PriorBand+BOBudget=10x, Prior Quality=Near Optimum2023.06 | 8.252 | |
| PriorBandBudget Horizon=5x, Prior Quality=Near Optimum2023.06 | 8.252 | |
| PriorBandBudget Horizon=1x, Prior Quality=Near Optimum2023.06 | 8.281 | |
| PriorBandBudget Horizon=5x, Prior Quality=Near Optimum2023.06 | 8.281 | |
| BOBudget=20x, Prior Quality=Near Optimum2023.06 | 9.115 | |
| πBOBudget=20x, Prior Quality=Good2023.06 | 9.222 | |
| BOBudget=20x, Prior Quality=Bad2023.06 | 9.354 | |
| PriorBandBudget Horizon=5x, Prior Quality=Good2023.06 | 9.413 | |
| BOBudget=20x, Prior Quality=Good2023.06 | 9.451 | |
| PriorBandBudget Horizon=12x, Prior Quality=Good2023.06 | 9.457 | |
| πBOBudget=10x, Prior Quality=Good2023.06 | 9.52 | |
| πBOBudget=20x, Prior Quality=Bad2023.06 | 9.534 | |
| PriorBand+BOBudget=20x, Prior Quality=Good2023.06 | 9.706 | |
| PriorBand+BOBudget=20x, Prior Quality=Bad2023.06 | 9.716 | |
| BOBudget=10x, Prior Quality=Near Optimum2023.06 | 9.723 | |
| ASHABudget Horizon=5x, Prior Quality=Near Optimum2023.06 | 9.739 | |
| ASHABudget Horizon=5x, Prior Quality=Good2023.06 | 9.739 | |
| ASHABudget Horizon=5x, Prior Quality=Bad2023.06 | 9.739 | |
| PriorBandBudget Horizon=5x, Prior Quality=Bad2023.06 | 9.806 | |
| AsyncHBBudget Horizon=5x, Prior Quality=Bad2023.06 | 9.869 | |
| PriorBand+BOBudget=10x, Prior Quality=Good2023.06 | 9.887 | |
| AsyncHBBudget Horizon=5x, Prior Quality=Near Optimum2023.06 | 9.901 | |
| AsyncHBBudget Horizon=5x, Prior Quality=Good2023.06 | 9.901 | |
| BOHBBudget=20x, Prior Quality=Near Optimum2023.06 | 9.969 | |
| BOHBBudget=20x, Prior Quality=Good2023.06 | 9.969 | |
| BOHBBudget=20x, Prior Quality=Bad2023.06 | 9.969 | |
| PriorBandBudget Horizon=5x, Prior Quality=Good2023.06 | 9.986 | |
| BOBudget=10x, Prior Quality=Good2023.06 | 10.049 | |
| PriorBandBudget Horizon=12x, Prior Quality=Bad2023.06 | 10.075 | |
| HBBudget Horizon=12x, Prior Quality=Near Optimum2023.06 | 10.077 | |
| BOBudget=10x, Prior Quality=Bad2023.06 | 10.132 | |
| PriorBandBudget Horizon=1x, Prior Quality=Good2023.06 | 10.194 | |
| PriorBand+BOBudget=10x, Prior Quality=Bad2023.06 | 10.213 | |
| πBOBudget=10x, Prior Quality=Bad2023.06 | 10.24 | |
| BOHBBudget=10x, Prior Quality=Near Optimum2023.06 | 10.281 | |
| BOHBBudget=10x, Prior Quality=Good2023.06 | 10.281 | |
| BOHBBudget=10x, Prior Quality=Bad2023.06 | 10.281 | |
| RSBudget Horizon=12x, Prior Quality=Near Optimum2023.06 | 10.451 | |
| PriorBandBudget Horizon=1x, Prior Quality=Bad2023.06 | 11.055 | |
| HBBudget Horizon=5x, Prior Quality=Near Optimum2023.06 | 11.129 | |
| ASHABudget Horizon=1x, Prior Quality=Near Optimum2023.06 | 11.382 | |
| ASHABudget Horizon=1x, Prior Quality=Good2023.06 | 11.382 | |
| ASHABudget Horizon=1x, Prior Quality=Bad2023.06 | 11.382 | |
| RSBudget Horizon=5x, Prior Quality=Near Optimum2023.06 | 11.454 | |
| PriorBandBudget Horizon=5x, Prior Quality=Bad2023.06 | 11.729 | |
| AsyncHBBudget Horizon=1x, Prior Quality=Bad2023.06 | 12.135 | |
| AsyncHBBudget Horizon=1x, Prior Quality=Near Optimum2023.06 | 12.192 | |
| AsyncHBBudget Horizon=1x, Prior Quality=Good2023.06 | 12.192 |