arrow
返回

Deterministic global optimization with Gaussian processes embedded

delete2021-06-25
delete29
delete
OA
AI
A
Artur M. Schweidtmann
D
Dominik Bongartz
D
Daniel Grothe
T
Tim Kerkenhoff
X
Xiaopeng Lin
J
Jaromił Najman
A
Alexander Mitsos *
DOI:10.1007/s12532-021-00204-ydelete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Gaussian processes (Kriging) are interpolating data-driven models that are frequently applied in various disciplines. Often, Gaussian processes are trained on datasets and are subsequently embedded as surrogate models in optimization problems. These optimization problems are nonconvex and global optimization is desired. However, previous literature observed computational burdens limiting deterministic global optimization to Gaussian processes trained on few data points. We propose a reduced-space formulation for deterministic global optimization with trained Gaussian processes embedded. For optimization, the branch-and-bound solver branches only on the free variables and McCormick relaxations are propagated through explicit Gaussian process models. The approach also leads to significantly smaller and computationally cheaper subproblems for lower and upper bounding. To further accelerate convergence, we derive envelopes of common covariance functions for GPs and tight relaxations of acquisition functions used in Bayesian optimization including expected improvement, probability of improvement, and lower confidence bound. In total, we reduce computational time by orders of magnitude compared to state-of-the-art methods, thus overcoming previous computational burdens. We demonstrate the performance and scaling of the proposed method and apply it to Bayesian optimization with global optimization of the acquisition function and chance-constrained programming. The Gaussian process models, acquisition functions, and training scripts are available open-source within the MeLOn-MachineLearning Models for Optimization toolbox (https://git.rwth-aachen.de/avt.svt/public/MeLOn).
Keyword:
Kriging
Machine learning
Bayesian optimization
Acquisition function
Chance-constrained programming
Reduced-space
Expected improvement
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Mathematical Programming Computation 封面图
Mathematical Programming Computation
IF:
3.6
论文数:
201
被引数:
1.9K

机构

R
RWTH Aachen University
学者数:
3.5W
论文数: 2.6W
被引数: 3.6W
引用论文

引用论文

Age‐related expression of molecular regulators of hypertrophy and maturation in articular cartilage
err2006-07-10
err0
errOAAI
errStacy A. Semevolos; Alan J. Nixon; Lisa A. Fortier; M. Lisa Strassheim; Jennifer Haupt
err分享
err收藏
Monoclonal IgM with unique specificity to gangliosides GM 1 and GD 1b and to lacto‐ N ‐tetraose associated with human motor neuron disease
err1988-05-01
err0
PREAI
errN. Latov; A. P. Hays; P. D. Donofrio; J. Liao H. Ito; S. McGinnis; K. Manoussos; L. Freddo; M. E. Shy; W. H. Sherman; H. W. Chang; H. S. Greenberg; J. W. Albers; A. G. Alessi; D. Keren; R. K. Yu; L. P. Rowland; E. A. Kabat
err分享
err收藏
A Trust Region Filter Method for Glass Box/Black Box Optimization
err2016-06-03
err60
PREAI
errEason, John P.; Biegler, Lorenz T.
err分享
err收藏
Taking the Human Out of the Loop: A Review of Bayesian Optimization将人类带出循环: 贝叶斯优化的回顾
err2016-01-01
err3.5K
PREAI
errShahriari, Bobak; Swersky, Kevin; Wang, Ziyu; Adams, Ryan P.; de Freitas, Nando
err分享
err收藏
Framework for Kriging-based iterative experimental analysis and design: Optimization of secretory protein production in Corynebacterium glutamicum
err2016-04-26
err26
errOAAI
errFreier, Lars; Hemmerich, Johannes; Schoeler, Katja; Wiechert, Wolfgang; Oldiges, Marco; von Lieres, Eric
err分享
err收藏
Systematic review and meta-analysis of antibiotic therapy for bone and joint infections
err2001-10-01
err0
PREAI
errDirk Stengel; Kai Bauwens; Jalid Sehouli; Axel Ekkernkamp; Franz Porzsolt
err分享
err收藏
学者 查看更多内容