arrow
Return

An Optimally Fast Objective-Function-Free Minimization Algorithm Using Random Subspaces

delete2026-05-14
delete0
delete
OA
AI
S
Stefania Bellavia *
S
Serge Gratton
B
Benedetta Morini
P
Philippe L. Toint
DOI:10.1007/s10957-026-03004-3delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
An algorithm for unconstrained non-convex optimization is described, which does not evaluate the objective function and in which minimization is carried out, at each iteration, within a randomly selected subspace. It is shown that this random approximation technique does not affect the convergence of the method or its evaluation complexity for the search of an epsilon-approximate first-order critical point, which is O(epsilon(-(P+1)/P)), where P is the order of derivatives used. A variant of the algorithm using approximate Hessian matrices is also analysed and shown to require at most O(epsilon(-2)) evaluations. Preliminary numerical tests show that the random-subspace technique can significantly improve performance when used with P = 2 in the correct context.
Keywords:
Nonlinear optimization
Stochastic adaptive regularisation methods
Sketching
Evaluation complexity
Objective-function-free optimization (OFFO)

Journal

J
Journal of Optimization Theory and Applications
IF:
1.5
Papers:
184
Citations:
8.2K

Organization

C
centre national de la recherche scientifique (cnrs)
Scholars:
24.5W
Papers: 18.2W
Citations: 279
U
university of florence
Scholars:
4.2W
Papers: 3.1W
Citations: 42
researcher View more organizations
Cited Papers

Cited Papers

errShare
errSave
researcher View more