arrow
Return

Solving higher dimensional expensive black box global optimization problems using sparse directional search on surrogates

delete2024-10-16
delete0
delete
OA
AI
L
Limeng Liu
M
Muming Yang
C
Christine A. Shoemaker
T
Tingting Xie *
DOI:10.1007/s12532-024-00267-7delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
We present a new algorithm Directional Optimization Search with Surrogate (DOSS), for optimizing problems with box constraints and a computationally expensive black-box objective function. DOSS is a radial basis function (RBF) based method that mainly focuses on higher dimensional and computationally expensive objective functions that can be multimodal. DOSS introduces three new techniques not previously used in earlier RBF algorithms, including using a combination of the coordinates knowledge level, fewer initial sampling points, and the surrogate's gradient information. Numerical results on a test set including 14 test problems with 36, 48, and 60 dimensions show that DOSS outperforms two recently published algorithms RBFOpt and TuRBO, and earlier RBF algorithms such as DYCORS. TuRBO is a Gaussian process based optimization algorithm, which outperformed earlier state-of-the-art methods. DOSS algorithm also has a good performance on real-world optimization problems, including robot pushing and rover trajectory planning problems. Almost sure convergence for the DOSS algorithm is also proven in this paper. An implementation of DOSS is available at https://doi.org/10.5281/zenodo.13731558.
Keywords:
90-08 Computational methods for problems pertaining to operations research and mathematical programming
90C26 Nonconvex programming
global optimization
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Mathematical Programming Computation cover
Mathematical Programming Computation
IF:
3.6
Papers:
197
Citations:
1.9K

Organization

A
academy of mathematics & system sciences, cas
Scholars:
755
Papers: 768
Citations: 0
N
National University of Singapore
Scholars:
7.5W
Papers: 6.5W
Citations: 11.4W
C
chinese academy of sciences
Scholars:
56.5W
Papers: 44.9W
Citations: 704
researcher View more organizations