arrow
Return

An Iterative Implementation of Variable Projection for Separable Nonlinear Optimization Problems

delete2022-11-01
delete7
PRE
AI
G
Guangyong Chen
甘敏 (Min Gan) *
H
Hongtao Zhu
陈龙 cover
陈龙 (Long Chen)
陈晨 cover
陈晨 (C. L. Philip Chen)
DOI:10.1109/TSMC.2022.3165323delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The separable nonlinear least-squares (SNLLS) problems considered in this article frequently appear in a wide range of research fields, such as machine learning, computer vision, system identification, and signal processing. The variable projection algorithm proposed by Golub and Pereyra, which reduces the dimension of the parameters by projecting the linear parameters out of the problem, is quite valuable in solving SNLLS problems. Previous implementations of the variable projection algorithm are based on matrix factorization. In this article, we propose an iterative implementation of the variable projection algorithm. Compared with previous implementations based on matrix decomposition, the proposed method can effectively avoid suffering from large condition number of the matrix or even matrix decomposition failure when dealing with ill-posed SNLLS problems. Numerical experiments on real-world data and synthetic data show the efficiency and robustness of the proposed iterative variable projection algorithm.
Keywords:
Parameter estimation
radial basis function network-based state-dependent autoregressive (RBF-AR) model
separable nonlinear least-squares (SNLLS) problem
variable projection

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

Q
Qingdao University
Scholars:
3.1W
Papers: 2.1W
Citations: 3.7W
S
southeast university - china
Scholars:
5.3W
Papers: 4.9W
Citations: 57
U
University of Macau
Scholars:
1.1W
Papers: 1.3W
Citations: 2.0W
S
south china university of technology
Scholars:
6.7W
Papers: 5.0W
Citations: 85
researcher View more organizations