arrow
返回

Bayesian Optimization for Expensive Smooth-Varying Functions

delete2022-07-01
delete5
PRE
AI
M
Mahdi Imani *
M
Mohsen Imani *
S
Seyede Fatemeh Ghoreishi
DOI:10.1109/MIS.2022.3163227delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Bayesian optimization (BO) is a powerful class of data-driven techniques for the maximization of expensive-to-evaluate objective functions. These techniques construct a Gaussian process (GP) regression for representing the objective function according to the latest available function evaluations and sequentially select samples and evaluate the function by maximizing an acquisition function. The primary assumption in most BO policies is that the objective function has a uniform level of smoothness over the input space, modeled by a kernel function. However, the uniform smoothness assumption is likely to be violated in a wide range of practical problems, primary domains in which the objective function is evaluated differently at various regions of input space (e.g., through different experiments, software, or approximators). This article develops a BO framework capable of optimizing expensive smooth-varying functions. Unlike the existing techniques that rely on a single GP model, the proposed framework constructs a set of local and global GP models to represent the objective function. The predictive mean and variance at any given sample in the input space are computed according to the posterior probabilities of the local and global GP models. Local and global models are adaptively controlled through a single parameter, which can be optimized along with other GP models' parameters during the optimization process. Using the predicted local and global values, the expected improvement acquisition function is employed as one of the possible acquisition functions for the selection process. The performance of the proposed framework is assessed extensively through two optimization benchmark problems.
Keyword:
GLOBAL OPTIMIZATION

期刊

IEEE Intelligent Systems 封面图
IEEE Intelligent Systems
IF:
6.1
论文数:
1.6K
被引数:
4.5K

机构

N
Northeastern University
学者数:
2.5W
论文数: 1.6W
被引数: 3.0W
University of California System 封面图
University of California System
学者数:
37.5W
论文数: 33.7W
被引数: 6.6K
引用论文

引用论文

Achieving robustness to aleatoric uncertainty with heteroscedastic Bayesian optimisation
err2021-11-24
err16
errOAAI
errGriffiths, Ryan-Rhys; Aldrick, Alexander A.; Garcia-Ortegon, Miguel; Lalchand, Vidhi; Lee, Alpha A.
err分享
err收藏
Taking the Human Out of the Loop: A Review of Bayesian Optimization将人类带出循环: 贝叶斯优化的回顾
err2016-01-01
err3.5K
PREAI
errShahriari, Bobak; Swersky, Kevin; Wang, Ziyu; Adams, Ryan P.; de Freitas, Nando
err分享
err收藏
Correction: Clinical Applicability and Cutoff Values for an Unstructured Neuropsychological Assessment Protocol for Older Adults with Low Formal Education
err2013-10-01
err0
errOAAI
errJonas Jardim de Paula; Laiss Bertola; Rafaela Teixeira Ávila; Lafaiete Moreira; Gabriel Coutinho; Edgar Nunes de Moraes; Maria Aparecida Camargos Bicalho; Rodrigo Nicolato; Breno Satler Diniz; Leandro Fernandes Malloy-Diniz
err分享
err收藏
Automatic Chemical Design Using a Data-Driven Continuous Representation of Molecules使用数据驱动的分子连续表示的自动化学设计
err2018-01-12
err2.5K
errOAAI
errGomez-Bombarelli, Rafael; Wei, Jennifer N.; Duvenaud, David; Hernandez-Lobato, Jose Miguel; Sanchez-Lengeling, Benjamin; Sheberla, Dennis; Aguilera-Iparraguirre, Jorge; Hirzel, Timothy D.; Adams, Ryan P.; Aspuru-Guzik, Alan
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
SynTReN: a generator of synthetic gene expression data for design and analysis of structure learning algorithms
err2006-01-26
err0
errOAAI
errTim Van den Bulcke; Koenraad Van Leemput; Bart Naudts; Piet van Remortel; Hongwu Ma; Alain Verschoren; Bart De Moor; Kathleen Marchal
err分享
err收藏
学者 查看更多内容