arrow
Return

Stochastic black-box optimization using multi-fidelity score function estimator

delete2025-01-31
delete0
delete
OA
AI
A
Atul Agrawal *
K
Kislaya Ravi
P
Phaedon‐Stelios Koutsourelakis
H
Hans‐Joachim Bungartz
DOI:10.1088/2632-2153/ad8e2bdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Optimizing parameters of physics-based simulators is crucial in the design process of engineering and scientific systems. This becomes particularly challenging when the simulator is stochastic, computationally expensive, black-box and when a high-dimensional vector of parameters needs to be optimized, as e.g. is the case in complex climate models that involve numerous interdependent variables and uncertain parameters. Many traditional optimization methods rely on gradient information, which is frequently unavailable in legacy black-box codes. To address these challenges, we present SCOUT-Nd (Stochastic Constrained Optimization for N dimensions), a gradient-based algorithm that can be used on non-differentiable objectives. It can be combined with natural gradients in order to further enhance convergence properties. and it also incorporates multi-fidelity schemes and an adaptive selection of samples in order to minimize computational effort. We validate our approach using standard, benchmark problems, demonstrating its superior performance in parameter optimization compared to existing methods. Additionally, we showcase the algorithm's efficacy in a complex real-world application, i.e. the optimization of a wind farm layout.
Keywords:
black-box optimization
multi-fidelity
score function estimator
windfarm layout optimization
optimization under uncertainty

Journal

M
Machine Learning-Science and Technology
IF:
4.6
Papers:
1.1K
Citations:
3.4K

Organization

T
Technical University of Munich
Scholars:
5.2W
Papers: 3.9W
Citations: 6.2W