arrow
Return

Bayesian optimization with approximate set kernels

delete2021-03-22
delete5
delete
OA
AI
J
Jungtaek Kim *
M
Michael McCourt
T
Tackgeun You
S
Saehoon Kim
S
Seungjin Choi
DOI:10.1007/s10994-021-05949-0delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
We propose a practical Bayesian optimization method over sets, to minimize a black-box function that takes a set as a single input. Because set inputs are permutation-invariant, traditional Gaussian process-based Bayesian optimization strategies which assume vector inputs can fall short. To address this, we develop a Bayesian optimization method with set kernel that is used to build surrogate functions. This kernel accumulates similarity over set elements to enforce permutation-invariance, but this comes at a greater computational cost. To reduce this burden, we propose two key components: (i) a more efficient approximate set kernel which is still positive-definite and is an unbiased estimator of the true set kernel with upper-bounded variance in terms of the number of subsamples, (ii) a constrained acquisition function optimization over sets, which uses symmetry of the feasible region that defines a set input. Finally, we present several numerical experiments which demonstrate that our method outperforms other methods.
Keywords:
Global optimization
Bayesian optimization
Set optimization

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

K
kakao
Scholars:
74
Papers: 47
Citations: 0
Cited Papers

Cited Papers

7. Fixed-Effects Negative Binomial Regression Models
err2002-08-01
err0
errOAAI
errPaul D. Allison; Richard P. Waterman
errShare
errSave
Towards energy-autonomous wake-up receiver using Visible Light Communication
err2016-01-01
err0
errOAAI
errJoyce Sariol Ramos; Ilker Demirkol; Josep Paradells; Daniel Vossing; Karim M. Gad; Martin Kasemann
errShare
errSave
Lead-free KNN-based thin films obtained by pulsed laser deposition
err2022-06-27
err0
errOAAI
errBrenda Carreno-Jimenez; Jose Luis Benitez-Benitez; Rosalba Castaneda-Guzman; M. Acuautla; Rigoberto Lopez-Juarez
errShare
errSave
Taking the Human Out of the Loop: A Review of Bayesian Optimization
err2016-01-01
err3.5K
PREAI
errShahriari, Bobak; Swersky, Kevin; Wang, Ziyu; Adams, Ryan P.; de Freitas, Nando
errShare
errSave
Growth stimulatory angiotensin II type-1 receptor is upregulated in breast hyperplasia and in situ carcinoma but not in invasive carcinoma
err2001-08-11
err0
PREAI
errBoel De Paepe; Valerie L. Verstraeten; Christian R. De Potter; Luc A. Vakaet; Gillian R. Bullock
errShare
errSave
Creating glasswing butterfly-inspired durable antifogging superomniphobic supertransmissive, superclear nanostructured glass through Bayesian learning and optimization
err2019-01-01
err39
PREAI
errHaghanifar, Sajad; McCourt, Michael; Cheng, Bolong; Wuenschell, Jeffrey; Ohodnicki, Paul; Leu, Paul W.
errShare
errSave
On drinking from a poisoned chalice
errBMJ
IF0
err2008-10-31
err0
PREAI
errR. Griffiths
errShare
errSave
Reservoir-Triggered Earthquakes Around the Atatürk Dam (Southeastern Turkey)
err2021-06-14
err0
errOAAI
errPınar Büyükakpınar; Simone Cesca; Sebastian Hainzl; Mohammadreza Jamalreyhani; Sebastian Heimann; Torsten Dahm
errShare
errSave
researcher View more