返回
Fast multiplicative algorithms for symmetric nonnegative tensor factorization
DOI:10.1016/j.neucom.2022.05.046.png)
摘要
En 中文
Symmetric nonnegative tensor factorization (SNTF) is an important tool for clustering analysis. To date, most of algorithms for SNTF are based on multiplicative update rules, which have many attractive properties, e.g., they are often simple to implement and can enforce nonnegativity without extra projection steps. However, the existing multiplicative algorithms often converge slowly due to the conservative multiplicative learning steps or the use of low-level BLAS (basic linear algebra subprograms) in their implementation. In this paper, three new multiplicative algorithms are proposed for SNTF to overcome the drawback of slow convergence. First, a parallel multiplicative algorithm, which can be implemented with high-level BLAS, is derived by auxiliary optimization. To further accelerate the convergence, two new parallel multiplicative algorithms, which enable larger learning steps for improving efficiency, are developed based on weighted geometric mean and weighted arithmetic mean, respectively. Finally, we apply the proposed algorithms to multiway probabilistic clustering, where a new hyper-stochastic normalization scheme based on Euclidean distance is developed for better data preprocessing. The experiment results on both synthetic and real-world data show that the proposed SNTF algorithms converge faster than the state-of-the-art algorithms.(c) 2022 Elsevier B.V. All rights reserved.
Keyword:
Symmetric nonnegative tensor factorization
Multiplicative updates
Auxiliary optimization
Multiway probabilistic clustering
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
Effects of stereoisomers of estradiol on food intake, body weight and hoarding behavior in female rats雌二醇立体异构体对雌性大鼠摄食、体重和囤积行为的影响
Convergence Analysis of Single Latent Factor-Dependent, Nonnegative, and Multiplicative Update-Based Nonnegative Latent Factor Models基于单个潜在因素依赖,非负和乘法更新的非负潜在因素模型的收敛性分析

