arrow
Return

An Experimental Study in Adaptive Kernel Selection for Bayesian Optimization

delete2019-01-01
delete11
delete
OA
AI
I
Ibai Roman *
R
Roberto Santana
A
Alexander Mendiburu
J
José A. Lozano
DOI:10.1109/ACCESS.2019.2960498delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Bayesian Optimization has been widely used along with Gaussian Processes for solving expensive-to-evaluate black-box optimization problems. Overall, this approach has shown good results, and particularly for parameter tuning of machine learning algorithms. Nonetheless, Bayesian Optimization has to be also configured to achieve the best possible performance, being the selection of the kernel function a crucial choice. This paper investigates the convenience of adaptively changing the kernel function during the optimization process, instead of fixing it a priori. Six adaptive kernel selection strategies are introduced and tested in well-known synthetic and real-world optimization problems. In order to provide a more complete evaluation of the proposed kernel selection variants, two major kernel parameter setting approaches have been tested. According to our results, apart from having the advantage of removing the selection of the kernel out of the equation, adaptive kernel selection criteria show a better performance than fixed-kernel approaches.
Keywords:
Adaptive kernel selection
Bayesian optimization
Gaussian process
parameter tuning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

U
university of basque country
Scholars:
1.9W
Papers: 1.6W
Citations: 17