arrow
Return

A NONMONOTONE MATRIX-FREE ALGORITHM FOR NONLINEAR EQUALITY-CONSTRAINED LEAST-SQUARES PROBLEMS

delete2021-09-13
delete2
delete
OA
AI
E
El Houcine Bergou *
Y
Youssef Diouane
V
Vyacheslav Kungurtsev
C
Clément W. Royer
DOI:10.1137/20M1349138delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Least squares form one of the most prominent classes of optimization problems with numerous applications in scientific computing and data fitting. When such formulations aim at modeling complex systems, the optimization process must account for nonlinear dynamics by incorporating constraints. In addition, these systems often incorporate a large number of variables, which increases the difficulty of the problem and motivates the need for efficient algorithms amenable to large-scale implementations. In this paper, we propose and analyze a Levenb erg-Marquardt algorithm for nonlinear least squares subject to nonlinear equality constraints. Our algorithm is based on inexact solves of linear least-squares problems that only require Jacobian-vector products. Global convergence is guaranteed by the combination of a composite step approach and a nonmonotone step acceptance rule. We illustrate the performance of our method on several test cases from data assimilation and inverse problems; our algorithm is able to reach the vicinity of a solution from an arbitrary starting point and can outperform the most natural alternatives for these classes of problems.
Keywords:
nonlinear least squares
equality constraints
Levenberg-Marquardt method
iter-ative linear algebra
PDE-constrained optimization
inverse problems

Journal

SIAM Journal on Scientific Computing cover
SIAM Journal on Scientific Computing
IF:
2.6
Papers:
5.1K
Citations:
1.8W

Organization

C
czech technical university prague
Scholars:
6.5K
Papers: 5.3K
Citations: 3
Institut Superieur de l'Aeronautique et de l'Espace cover
Institut Superieur de l'Aeronautique et de l'Espace
Scholars:
514
Papers: 410
Citations: 405
U
universite de toulouse
Scholars:
3.5W
Papers: 2.7W
Citations: 37
M
mohammed vi polytechnic university
Scholars:
3.4K
Papers: 2.4K
Citations: 48
researcher View more organizations