.png){kind=icon}
返回
A Momentum Accelerated Algorithm for ReLU-Based Nonlinear Matrix Decomposition
.png){kind=icon}
PRE
AI
DOI：10.1109/LSP.2024.3475910.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Recently, there has been a growing interest in the exploration of Nonlinear Matrix Decomposition (NMD) due to its close ties with neural networks. NMD aims to find a low-rank matrix from a sparse nonnegativematrixwith a per-element nonlinear function. A typical choice is the Rectified Linear Unit (ReLU) activation function. To address over-fitting in the existing ReLU-based NMD model (ReLU-NMD), we propose a Tikhonov regularized ReLU-NMD model, referred to as ReLU-NMD-T. Subsequently, we introduce a momentum accelerated algorithm for handling the ReLU-NMD-Tmodel. A distinctive feature, setting our work apart from most existing studies, is the incorporation of both positive and negative momentum parameters in our algorithm. Our numerical experiments on real-world datasets show the effectiveness of the proposed model and algorithm.
Keyword:
Alternating minimization
low-rank matrix decomposition
momentum
nonlinearity.
期刊
IF:
9.6
论文数:
1.1W
被引数:
1.7W
机构
引用论文
Small Silencing RNAs in Plants Are Mobile and Direct Epigenetic Modification in Recipient Cells.png)
Science
ScienceIF0
PREAI
分享收藏The benefits of providing benefit information in a patient information leaflet在患者信息手册中提供获益信息的益处
PREAI
分享收藏
分享收藏Studies of Disturbed Regions Near Discontinuities in Reinforced Concrete Members钢筋混凝土构件不连续区域附近扰动区域的研究
PREAI
分享收藏Application of Special Sensor for Deformation Modulus Test of Plastic Concrete特殊传感器在塑性混凝土变形模量测试中的应用
PREAI
分享收藏
查看更多内容