arrow
Return

Efficient unconstrained black box optimization

delete2022-02-03
delete10
delete
OA
AI
M
Morteza Kimiaei *
A
Arnold Neumaier
DOI:10.1007/s12532-021-00215-9delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
For the unconstrained optimization of black box functions, this paper introduces a new randomized algorithm called VRBBO. In practice, VRBBO matches the quality of other state-of-the-art algorithms for finding, in small and large dimensions, a local minimizer with reasonable accuracy. Although our theory guarantees only local minimizers our heuristic techniques turn VRBBO into an efficient global solver. In very thorough numerical experiments, we found in most cases either a global minimizer, or where this could not be checked, at least a point of similar quality to the best competitive global solvers. For smooth, everywhere defined functions, it is proved that, with probability arbitrarily close to 1, a basic version of our algorithm finds with O(n epsilon(-2)) function evaluations a point whose unknown exact gradient 2-norm is below a given threshold epsilon > 0, where n is the dimension. In the smooth convex case, this number improves to O(n log epsilon(-1)) and in the smooth (strongly) convex case to O(n log n epsilon(-1)). This matches known recent complexity results for reaching a slightly different goal, namely the expected unknown exact gradient 2-norm is below a given threshold epsilon > 0. Numerical results show that VRBBO is effective and robust in comparison with the state-of-the-art local and global solvers on the unconstrained CUTEst test problems of GOULD et al. (Comput Optim Appl 60:545-557, 2014) for optimization and the test problems of JAMIL and YANG (Int J Math Model Numer Optim 4:150, 2013) for global optimization with 2-5000 variables.
Keywords:
Derivative-free optimization
complexity bounds
global optimization
sufficient decrease
line search

Journal

Mathematical Programming Computation cover
Mathematical Programming Computation
IF:
3.6
Papers:
201
Citations:
1.9K

Organization

U
University of Vienna
Scholars:
1.7W
Papers: 1.6W
Citations: 40
Cited Papers

Cited Papers

Thermokinetic model establishment and numerical simulation of 2,4,6-trinitrophenol based on eco-friendly synthesis method
err2021-11-25
err0
PREAI
errYe-Cheng Liu; An-Chi Huang; Yan Tang; Xiao-Ming Ma; Ya-Ping Yang; Zhi-Hao Wu; Chi-Min Shu; Zhi-Xiang Xing; Jun-Cheng Jiang
errShare
errSave
Mental health among younger and older caregivers of dementia patients
err2016-03-10
err0
PREAI
errAsuka Koyama; Masateru Matsushita; Mamoru Hashimoto; Noboru Fujise; Tomohisa Ishikawa; Hibiki Tanaka; Yutaka Hatada; Yusuke Miyagawa; Maki Hotta; Manabu Ikeda
errShare
errSave
Amorphous TiZr - base metglas® brazing filler metals
err1991-02-01
err0
PREAI
errA. Rabinkin; H. Liebermann; S. Pounds; T. Taylor; F. Reidinger; Siu-Ching Lui
errShare
errSave
errShare
errSave
Origin of Structural Change Driven by A-Site Lanthanide Doping in ABO3-Type Perovskite Ferroelectrics
err2020-05-29
err0
errOAAI
errLan Xu; Zujian Wang; Bin Su; Chenxi Wang; Xiaoming Yang; Rongbing Su; Xifa Long; Chao He
errShare
errSave
researcher View more