arrow
Return

Consequential improvement acquisition function for efficient multi-fidelity Bayesian optimization

delete2026-03-01
delete0
PRE
AI
I
Ibrahim Aydogdu
M
Michaela Kempner
S
Sestito, Jesse M.
E
Eva Zarkadoula
H
Hongyuan Zha
Y
Yan Wang *
DOI:10.1007/s11081-026-10078-5delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Surrogate-based Bayesian optimization has been widely applied in design optimization to increase sampling efficiency. However, the cost for each evaluation of the objective function can still be very high when physical experiments or large-scale simulations are involved. Multi-fidelity Bayesian optimization is the new approach to further improve the sampling efficiency by reducing the number of expensive samples at the highest fidelity level and supplementing them with less expensive ones at low-fidelity levels. In this paper, a new consequential improvement (CI) acquisition function is proposed to allow for the simultaneous selection of the solution and the fidelity level in problems with a known hierarchy of fidelity levels. The new CI acquisition function incorporates the consequential effectiveness of objective improvement with the considerations of cost, accuracy, and validity differences between high- and low-fidelity samples in engineering practice. The new method of multi-fidelity Bayesian optimization based on the CI is demonstrated with several analytical and simulation-based design examples. In the simulation-based design optimization example, the results show that the CI acquisition function has a decisive advantage in the sampling efficiency over the other methods of multi-fidelity Bayesian optimization with simultaneous selection. The results indicate that the proposed method is particularly advantageous in solving high-dimensional problems and when large cost ratios between high- and low-fidelity evaluations exist and high-fidelity validation is mandatory. Furthermore, the method robustly avoids the prevalent issue of over sampling at low-fidelity levels.
Keywords:
Multi-fidelity Bayesian optimization
Active learning
Gaussian process

Journal

O
Optimization and Engineering
IF:
1.7
Papers:
74
Citations:
0

Organization

V
valparaíso university
Scholars:
7
Papers: 7
Citations: 0
U
university system of georgia
Scholars:
7.3W
Papers: 6.5W
Citations: 101
A
Akdeniz University
Scholars:
5.4K
Papers: 3.9K
Citations: 2.6K
U
united states department of energy (doe)
Scholars:
11.3W
Papers: 9.6W
Citations: 246
researcher View more organizations