arrow
Return

SELECTING REGULARIZATION PARAMETERS FOR NUCLEAR NORM-TYPE MINIMIZATION PROBLEMS

delete2022-08-01
delete2
delete
OA
AI
李珂欣 cover
李珂欣 (Kexin Li)
H
Hongwei Li
R
Raymond H. Chan
Y
You‐Wei Wen *
DOI:10.1137/21M143786Xdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The reconstruction of a low-rank matrix from its noisy observation finds its usage in many applications. It can be reformulated into a constrained nuclear norm minimization problem, where the bound eta of the constraint is explicitly given or can be estimated by the probability distribution of the noise. When the Lagrangian method is applied to find the minimizer, the solution can be obtained by the singular value thresholding operator, where the thresholding parameter lambda is related to the Lagrangian multiplier. In this paper, we first show that the Frobenius norm of the discrepancy between the minimizer and the observed matrix is a strictly monotonically increasing function of lambda. From that we derive a closed form solution for lambda in terms of eta. Since lambda is the same as the regularization parameter for the unconstrained regularized problem, our results can be applied to automatically choosing a suitable regularization parameter for the nuclear norm-type regularized minimization problems using the discrepancy principle. The regularization parameters obtained are comparable to (and sometimes better than) those obtained by Stein's unbiased risk estimator approach, while the cost of solving the minimization problem can be reduced by 11-18 times. Numerical experiments with both synthetic data and real MRI data are performed to validate the proposed approach.
Keywords:
low-rank matrix
singular value thresholding
discrepancy principle
nuclear norm
regularization parameter

Journal

SIAM Journal on Scientific Computing cover
SIAM Journal on Scientific Computing
IF:
2.6
Papers:
5.1K
Citations:
1.8W

Organization

H
Hunan Normal University
Scholars:
1.3W
Papers: 8.2K
Citations: 9.1K
C
capital normal university
Scholars:
6.4K
Papers: 4.4K
Citations: 3
C
City University of Hong Kong
Scholars:
2.3W
Papers: 3.0W
Citations: 6.1W
researcher View more organizations