.png){kind=icon}
Return
Deterministic global optimization with Gaussian processes embedded
.png){kind=icon}
OA
AI
DOI：10.1007/s12532-021-00204-y.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Gaussian processes (Kriging) are interpolating data-driven models that are frequently applied in various disciplines. Often, Gaussian processes are trained on datasets and are subsequently embedded as surrogate models in optimization problems. These optimization problems are nonconvex and global optimization is desired. However, previous literature observed computational burdens limiting deterministic global optimization to Gaussian processes trained on few data points. We propose a reduced-space formulation for deterministic global optimization with trained Gaussian processes embedded. For optimization, the branch-and-bound solver branches only on the free variables and McCormick relaxations are propagated through explicit Gaussian process models. The approach also leads to significantly smaller and computationally cheaper subproblems for lower and upper bounding. To further accelerate convergence, we derive envelopes of common covariance functions for GPs and tight relaxations of acquisition functions used in Bayesian optimization including expected improvement, probability of improvement, and lower confidence bound. In total, we reduce computational time by orders of magnitude compared to state-of-the-art methods, thus overcoming previous computational burdens. We demonstrate the performance and scaling of the proposed method and apply it to Bayesian optimization with global optimization of the acquisition function and chance-constrained programming. The Gaussian process models, acquisition functions, and training scripts are available open-source within the MeLOn-MachineLearning Models for Optimization toolbox (https://git.rwth-aachen.de/avt.svt/public/MeLOn).
Keywords:
Kriging
Machine learning
Bayesian optimization
Acquisition function
Chance-constrained programming
Reduced-space
Expected improvement
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
3.6
Papers:
201
Citations:
1.9K
Organization
Cited Papers
Age‐related expression of molecular regulators of hypertrophy and maturation in articular cartilageOAAI
OAAIShareSaveMonoclonal IgM with unique specificity to gangliosides GM
1
and GD
1b
and to lacto‐
N
‐tetraose associated with human motor neuron disease.png)
Neurology
NeurologyIF0
PREAI
ShareSaveTaking the Human Out of the Loop: A Review of Bayesian OptimizationPROCEEDINGS OF THE IEEE
PROCEEDINGS OF THE IEEEIF25.9
PREAI
ShareSave
View more