arrow
Return

Generative Multiform Bayesian Optimization

delete2023-07-01
delete11
PRE
AI
Z
Zhendong Guo *
刘海涛 cover
刘海涛 (Haitao Liu)
Y
Yew-Soon Ong
X
Xinghua Qu
Y
Yuzhe Zhang
J
Jianmin Zheng
DOI:10.1109/TCYB.2022.3165044delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Many real-world problems, such as airfoil design, involve optimizing a black-box expensive objective function over complex-structured input space (e.g., discrete space or non-Euclidean space). By mapping the complex-structured input space into a latent space of dozens of variables, a two-stage procedure labeled as generative model-based optimization (GMO), in this article, shows promise in solving such problems. However, the latent dimension of GMO is hard to determine, which may trigger the conflicting issue between desirable solution accuracy and convergence rate. To address the above issue, we propose a multiform GMO approach, namely, generative multiform optimization (GMFoO), which conducts optimization over multiple latent spaces simultaneously to complement each other. More specifically, we devise a generative model which promotes a positive correlation between latent spaces to facilitate effective knowledge transfer in GMFoO. And furthermore, by using Bayesian optimization (BO) as the optimizer, we propose two strategies to exchange information between these latent spaces continuously. Experimental results are presented on airfoil and corbel design problems and an area maximization problem as well to demonstrate that our proposed GMFoO converges to better designs on a limited computational budget.
Keywords:
Optimization
Training
Convergence
Task analysis
Linear programming
Bayes methods
Generators
Bayesian optimization (BO)
generative model-based optimization (GMO)
multiform optimization (MFoO)
transfer optimization (TO)

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

N
Nanyang Technological University
Scholars:
4.9W
Papers: 4.8W
Citations: 8.1W
D
Dalian University of Technology
Scholars:
5.8W
Papers: 4.3W
Citations: 5.5W