arrow
返回

A fast DC-based dictionary learning algorithm with the SCAD penalty

delete2021-03-01
delete3
PRE
AI
Z
Zhenni Li
C
Chao Wan
B
Benying Tan
Z
Zuyuan Yang *
Xie Shengli 封面图
Xie Shengli (Shengli Xie)
DOI:10.1016/j.neucom.2020.12.003delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In recent years, there has been growing concerns on the study of dictionary learning with the nonconvex sparsity-including penalty. However, how to efficiently address the dictionary learning with the nonconvex penalty is still an open problem. In this paper, we present an efficient DC-based algorithm for dictionary learning with the nonconvex smoothly clipped absolute deviation (SCAD) penalty for strong sparsity and accurate estimation. The optimization problem we considered can be generalized as a minimization of the representation error with the SCAD penalty. The approach we proposed is based on a decomposition scheme which decomposes the whole problem into a set of subproblems with regard to single-vector factors. For handling the nonconvexity of the representation error in the subproblems, we use an alternating optimization scheme to update one factor with the other factor fixed. For tackling the nonconvexity of the SCAD penalty in the subproblems, we apply the Difference of Convex functions (DC) technology to convert the nonconvex subproblem into the resulting convex problems and thus employ DC algorithm to solve the corresponding optimization; thus the simple and straightforward solutions in the closed form can be easily derived. As verified by the numerical experiments with synthetic and real-world data, the proposed algorithm performs better than the state-of-the-art algorithms with different sparsity-including constraints. (C) 2020 Elsevier B.V. All rights reserved.
Keyword:
Dictionary learning
Sparse representation
Nonconvex penalty
Difference of Convex functions (DC)
Alternating optimization
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

G
guangdong university of technology
学者数:
3.0W
论文数: 2.0W
被引数: 36
引用论文

引用论文

Magnetic field corrections to solar oscillation frequencies
err1986-10-01
err0
PREAI
errB. Roberts; W. R. Campbell
err分享
err收藏
The dual-tree complex wavelet transform
err2005-11-01
err2.0K
PREAI
errSelesnick, IW; Baraniuk, RG; Kingsbury, NG
err分享
err收藏
学者 查看更多内容