返回
Improved SVD-based initialization for nonnegative matrix factorization using low-rank correction
DOI:10.1016/j.patrec.2019.02.018.png)
摘要
En 中文
Due to the iterative nature of the most nonnegative matrix factorization (NMF) algorithms, initialization is a key aspect as it significantly influences both the convergence and the final solution obtained. Many initialization schemes have been proposed for NMF, among which one of the most popular class of methods are based on the singular value decomposition (SVD) and clustering. However, these SVD-based initializations as well as clustering based initializations (if they dense their right factor H), do not satisfy a rather natural condition, namely that the error should decrease as the rank of factorization increases. In this paper, we propose a novel SVD-based NMF initialization to specifically address this shortcoming by taking into account the SVD factors that were discarded to obtain a nonnegative initialization. This method, referred to as nonnegative SVD with low-rank correction (NNSVD-LRC), allows us to significantly reduce the initial error at a negligible additional computational cost using the low-rank structure of the discarded SVD factors. NNSVD-LRC has two other advantages compared to other NMF initializations: (1) it provably generates sparse initial factors, and (2) it is faster as it only requires to compute a truncated SVD of rank left perpendicular r/2 + 1 right perpendicular where r is the factorization rank of the sought NMF decomposition (as opposed to a rank-r truncated SVD for other methods). We show on several standard dense and sparse data sets that our new method competes favorably with state-of-the-art SVD-based and clustering based initializations for NMF. (C) 2019 Elsevier B.V. All rights reserved.
Keyword:
Nonnegative matrix factorization
Initialization
Singular value decomposition
Clustering based NMF initialization
CR1-NMF
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.3
论文数:
7.9K
被引数:
1.6W

