arrow
返回

Batch Bayesian optimization via adaptive local search

delete2020-09-19
delete8
PRE
AI
J
Jingfei Liu
Chao Jiang 封面图
Chao Jiang (Chao Jiang) *
J
Jing Zheng
DOI:10.1007/s10489-020-01790-5delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Bayesianoptimization (BO) provides an efficient tool for solving the black-box global optimization problems. Under situations where multiple points can be evaluated simultaneously, batch Bayesian optimization has been a popular extension by taking full use of the computational and experimental resources. In this paper, an adaptive local search strategy is investigated to select batch points for Bayesian optimization. First, multi-start strategy and gradient-based optimization method are combined to maximize the acquisition function. Then, an automatic cluster approach (e.g., X-means) is applied to adaptively identify the acquisition function's local maxima from the gradient-based optimization results. Third, the Bayesian stopping criterion is utilized to guarantee all the local maxima can be obtained theoretically. Moreover, the lower bound confidence criterion and frontend truncation operation are employed to select the most promising local maxima as batch points. Extensive evaluations on various synthetic functions and two hyperparameter tuning problems for deep learning models are utilized to verify the proposed method.
Keyword:
Batch Bayesian optimization
Adaptive local search
Parallel search
Hyperparameter tuning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.6K
被引数:
1.7W

机构

H
hunan university
学者数:
4.5W
论文数: 3.3W
被引数: 70
引用论文

引用论文

Taking the Human Out of the Loop: A Review of Bayesian Optimization将人类带出循环: 贝叶斯优化的回顾
err2016-01-01
err3.5K
PREAI
errShahriari, Bobak; Swersky, Kevin; Wang, Ziyu; Adams, Ryan P.; de Freitas, Nando
err分享
err收藏
Gaussian process for predicting CPU utilization and its application to energy efficiency
err2015-07-02
err12
PREAI
errDinh-Mao Bui; Huu-Quoc Nguyen; Yoon, YongIk; Jun, SungIk; Amin, Muhammad Bilal; Lee, Sungyoung
err分享
err收藏
Phase I/II study of monoclonal antibody against Lewis Y hapten in relapsed small-cell lung cancer
err1992-04-01
err0
errOAAI
errR.A. Stahel; H. Lacroix; J.P. Sculier; R. Morant; J. Richner; E. Janzek; H. Loibner; H. Blythman
err分享
err收藏
Gravitational Clustering: A simple, robust and adaptive approach for distributed networks
err2018-08-01
err12
errOAAI
errBinder, Patricia; Muma, Michael; Zoubir, Abdelhak M.
err分享
err收藏
学者 查看更多内容