返回
A Hierarchical Expected Improvement Method for Bayesian Optimization
DOI:10.1080/01621459.2023.2210803.png)
摘要
En 中文
The Expected Improvement (EI) method, proposed by Jones, Schonlau, andWelch, is a widely used Bayesian optimization method, which makes use of a fitted Gaussian process model for efficient black-box optimization. However, one key drawback of EI is that it is overly greedy in exploiting the fitted Gaussian process model for optimization, which results in suboptimal solutions even with large sample sizes. To address this, we propose a new hierarchical EI (HEI) framework, which makes use of a hierarchical Gaussian process model. HEI preserves a closed-form acquisition function, and corrects the over-greediness of EI by encouraging exploration of the optimization space. We then introduce hyperparameter estimation methods which allow HEI to mimic a fully Bayesian optimization procedure, while avoiding expensive Markov-chain Monte Carlo sampling steps. We prove the global convergence of HEI over a broad function space, and establish near-minimax convergence rates under certain prior specifications. Numerical experiments show the improvement of HEI over existing Bayesian optimization methods, for synthetic functions and a semiconductor manufacturing optimization problem. for this article are available online.
Keyword:
Black-box optimization
Experimental design
Gaussian process
Global optimization
Hierarchical modeling
Uncertainty quantification
期刊
J
IF:
3
论文数:
5.2K
被引数:
4.8W
机构
引用论文
Utilization of phage display to identify antigenic regions in the PCV2 capsid protein for the evaluation of serological responses in mice and pigs利用噬菌体展示技术识别PCV2衣壳蛋白中的抗原决定簇区域,以评估小鼠和猪的血清学反应
Contribution of carotenoids to the optical activity of human serum low-density lipoprotein
Biochemistry
IF0
Thermal decomposition of the solvent extracted molybdenum (VI) complexes from hydrochloric acid solutions with trioctylamine and trioctylmethylammonium chloride从盐酸溶液中用三辛胺和三辛基甲基氯化铵萃取的钼(VI)络合物的热分解

