arrow
Return

A THREE-OPERATOR SPLITTING ALGORITHM FOR NONCONVEX SPARSITY REGULARIZATION

delete2021-08-05
delete9
delete
OA
AI
F
Fengmiao Bian *
X
Xiaoqun Zhang
DOI:10.1137/20M1326775delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Sparsity regularization has been widely adopted in many fields, such as signal and image processing and machine learning. In this paper, we mainly consider nonconvex minimization problems involving three terms, for applications such as sparse signal recovery and low rank matrix recovery. We employ a three-operator splitting proposed by Davis and Yin [Set-Valued Var. Anal., 25 (2017), pp. 829-858] (namely, DYS) to solve the resulting possibly nonconvex problems and develop the convergence theory for this three-operator splitting algorithm in the nonconvex case. We show that when the step size is chosen less than a computable threshold, the whole sequence converges to a stationary point. By defining a new decreasing energy function associated with the DYS method, we establish the global convergence of the whole sequence and a local convergence rate under an additional assumption that F, G, and H are semialgebraic. We also provide sufficient conditions for the boundedness of the generated sequence. Finally, some numerical experiments are conducted to compare the DYS algorithm with some classical efficient algorithms for sparse signal recovery and low rank matrix completion. The numerical results indicate that DYS outperforms the existing methods for these applications.
Keywords:
three-operator splitting method
sparsity regularization
sparse signal recovery
low rank matrix completion
nonconvex optimization

Journal

SIAM Journal on Scientific Computing cover
SIAM Journal on Scientific Computing
IF:
2.6
Papers:
5.1K
Citations:
1.8W

Organization

S
shanghai jiao tong university
Scholars:
15.5W
Papers: 11.6W
Citations: 159