Hyperparameter Optimization on JAHS-Bench CH (val)
4.399Validation ErrorPriorBand
Evaluation Results
| Method | Links | |
|---|---|---|
| PriorBandBudget Horizon=5x, Prior Quality=Near Optimum2023.06 | 4.399 | |
| PriorBandBudget Horizon=12x, Prior Quality=Near Optimum2023.06 | 4.445 | |
| PriorBandBudget Horizon=5x, Prior Quality=Near Optimum2023.06 | 4.449 | |
| PriorBand+BOBudget=10x, Prior Quality=Near Optimum2023.06 | 4.452 | |
| PriorBandBudget Horizon=1x, Prior Quality=Near Optimum2023.06 | 4.466 | |
| PriorBandBudget Horizon=5x, Prior Quality=Good2023.06 | 5.238 | |
| PriorBandBudget Horizon=5x, Prior Quality=Bad2023.06 | 5.316 | |
| PriorBand+BOBudget=20x, Prior Quality=Good2023.06 | 5.393 | |
| ASHABudget Horizon=5x, Prior Quality=Near Optimum2023.06 | 5.492 | |
| ASHABudget Horizon=5x, Prior Quality=Good2023.06 | 5.492 | |
| ASHABudget Horizon=5x, Prior Quality=Bad2023.06 | 5.492 | |
| PriorBandBudget Horizon=12x, Prior Quality=Bad2023.06 | 5.551 | |
| AsyncHBBudget Horizon=5x, Prior Quality=Near Optimum2023.06 | 5.565 | |
| AsyncHBBudget Horizon=5x, Prior Quality=Good2023.06 | 5.565 | |
| AsyncHBBudget Horizon=5x, Prior Quality=Bad2023.06 | 5.565 | |
| PriorBandBudget Horizon=12x, Prior Quality=Good2023.06 | 5.589 | |
| HBBudget Horizon=12x, Prior Quality=Near Optimum2023.06 | 5.704 | |
| PriorBandBudget Horizon=5x, Prior Quality=Good2023.06 | 5.974 | |
| RSBudget Horizon=12x, Prior Quality=Near Optimum2023.06 | 5.977 | |
| πBOBudget=20x, Prior Quality=Bad2023.06 | 6.204 | |
| ASHABudget Horizon=1x, Prior Quality=Near Optimum2023.06 | 6.325 | |
| ASHABudget Horizon=1x, Prior Quality=Good2023.06 | 6.325 | |
| ASHABudget Horizon=1x, Prior Quality=Bad2023.06 | 6.325 | |
| HBBudget Horizon=5x, Prior Quality=Near Optimum2023.06 | 6.332 | |
| PriorBandBudget Horizon=5x, Prior Quality=Bad2023.06 | 6.553 | |
| PriorBandBudget Horizon=1x, Prior Quality=Good2023.06 | 6.603 | |
| PriorBandBudget Horizon=1x, Prior Quality=Bad2023.06 | 6.622 | |
| RSBudget Horizon=5x, Prior Quality=Near Optimum2023.06 | 6.752 | |
| AsyncHBBudget Horizon=1x, Prior Quality=Near Optimum2023.06 | 6.771 | |
| AsyncHBBudget Horizon=1x, Prior Quality=Good2023.06 | 6.771 | |
| AsyncHBBudget Horizon=1x, Prior Quality=Bad2023.06 | 6.771 |