arrow
Return

FAST AND ROBUST CONSENSUS-BASED OPTIMIZATION VIA OPTIMAL FEEDBACK CONTROL

delete2026-01-01
delete0
PRE
AI
Y
Yuyang Huang *
M
Michaël Herty
D
Dante Kalise
N
Nikolas Kantas
DOI:10.1137/24M170644Xdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
CBO, which introduces a feedback control term to improve convergence towards global minimizers of nonconvex functions in multiple dimensions. The feedback law is a gradient of a numerical approximation to the Hamilton--Jacobi--Bellman (HJB) equation, which serves as a proxy of the original objective function. Thus, the associated control signal furnishes gradient-like information to facilitate the identification of the global minimum without requiring derivative computation from the objective function itself. The proposed method exhibits significantly improved performance over standard CBO methods in numerical experiments, particularly in scenarios involving a limited number of particles, or where the initial particle ensemble is not well positioned with respect to the global minimum. At the same time, the modification keeps the algorithm amenable to theoretical analysis in the mean-field sense. The superior convergence rates are assessed experimentally.
Keywords:
global optimization
consensus-based optimization
Hamilton-Jacobi-Bellman PDEs
high-dimensional polynomial approximation

Journal

SIAM Journal on Scientific Computing cover
SIAM Journal on Scientific Computing
IF:
2.6
Papers:
5.1K
Citations:
1.8W

Organization

I
imperial college london
Scholars:
9.9K
Papers: 4.4K
Citations: 0
R
rwth aachen university
Scholars:
4.1K
Papers: 1.3K
Citations: 0
Cited Papers

Cited Papers

A Consensus-Based Global Optimization Method with Adaptive Momentum Estimation
err2022-01-01
err0
PREAI
errJingrun Chen Jingrun Chen; Shi Jin Shi Jin; Liyao Lyu Liyao Lyu
errShare
errSave
Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations
err
IF0
err1997-01-01
err0
errOAAI
errMartino Bardi; Italo Capuzzo-Dolcetta
errShare
errSave
errShare
errSave
Deep relaxation: partial differential equations for optimizing deep neural networks
err2018-06-28
err0
errOAAI
errPratik Chaudhari; Adam Oberman; Stanley Osher; Stefano Soatto; Guillaume Carlier
errShare
errSave
errShare
errSave
Smooth Convex Optimization
err2004-01-01
err0
PREAI
errNesterov,Yurii
errShare
errSave
researcher View more