arrow
Return

Bayesian optimization with partially specified queries

delete2022-01-01
delete1
delete
OA
AI
S
Shogo Hayashi *
J
Junya Honda
H
Hisashi Kashima
DOI:10.1007/s10994-021-06079-3delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Bayesian optimization (BO) is an approach to optimizing an expensive-to-evaluate black-box function and sequentially determines the values of input variables to evaluate the function. However, it is expensive and in some cases becomes difficult to specify values for all input variables, for example, in outsourcing scenarios where production of input queries with many input variables involves significant cost. In this paper, we propose a novel Gaussian process bandit problem, BO with partially specified queries (BOPSQ). In BOPSQ, unlike the standard BO setting, a learner specifies only the values of some input variables, and the values of the unspecified input variables are randomly determined according to a known or unknown distribution. We propose two algorithms based on posterior sampling for cases of known and unknown input distributions. We further derive their regret bounds that are sublinear for popular kernels. We demonstrate the effectiveness of the proposed algorithms using test functions and real-world datasets.
Keywords:
Bayesian optimization
multi-armed bandit
Thompson sampling

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

K
Kyoto University
Scholars:
5.1W
Papers: 4.6W
Citations: 6.1W
N
nec corporation
Scholars:
1.0K
Papers: 955
Citations: 0