arrow
Return

An Efficient Decoupled Optimization Algorithm for a Class of Regression Models

delete2025-01-01
delete0
PRE
AI
G
Guang-Yong Chen
Y
Yi Liao
X
Xiang-Xiang Su
M
Min Gan
陈晨 cover
陈晨 (C. L. Philip Chen)
DOI:10.1109/LSP.2025.3588030delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This letter proposes an efficient Decoupled Optimization Algorithm (DOA) to address a class of regression problems commonly encountered in signal processing, system identification, and machine learning. Unlike existing methods such as proximal gradient algorithms and Alternating Direction Method of Multipliers (ADMM), the DOA algorithm incorporates the core principles of variable projection to resolve the coupling relationships between different parameters in the optimization process and express some parameters as functions of others, allowing for efficient optimization in a reduced-dimensional space. Furthermore, we investigate strategies for addressing these coupling relationships in both first-order and second-order settings, leading to the development of two variants of DOA: DOA-1 and DOA-2, each tailored to different application requirements. Finally, numerical experiments demonstrate that the DOA algorithm significantly accelerates convergence, confirming its effectiveness.
Keywords:
Least absolute deviation
system identification
variable projection
robust principle component analysis

Journal

IEEE Signal Processing Magazine cover
IEEE Signal Processing Magazine
IF:
9.6
Papers:
1.1W
Citations:
1.7W

Organization

Q
Qingdao University
Scholars:
3.1W
Papers: 2.1W
Citations: 3.7W
F
fuzhou university
Scholars:
3.3W
Papers: 2.1W
Citations: 31
S
south china university of technology
Scholars:
6.8W
Papers: 5.1W
Citations: 85
researcher View more organizations
Cited Papers

Cited Papers

First-Order Methods in Optimization
err
IF0
err2017-10-04
err0
PREAI
errAmir Beck
errShare
errSave
Power Variable Projection for Initialization-Free Large-Scale Bundle Adjustment
err
IF0
err2024-10-26
err0
PREAI
errSimon Weber; Je Hyeong Hong; Daniel Cremers
errShare
errSave
Robust PCA Unrolling Network for Super-Resolution Vessel Extraction in X-Ray Coronary Angiography
err2022-11-01
err14
errOAAI
errQin, Binjie; Mao, Haohao; Liu, Yiming; Zhao, Jun; Lv, Yisong; Zhu, Yueqi; Ding, Song; Chen, Xu
errShare
errSave
Learning Robust and Sparse Principal Components With the α-Divergence
err2024-01-01
err0
PREAI
errRekavandi, Aref Miri; Seghouane, Abd-Krim; Evans, Robin J.
errShare
errSave
researcher View more