.png){kind=icon}
返回
Distributed Bayesian Matrix Decomposition for Big Data Mining and Clustering
.png){kind=icon}
OA
AI
DOI：10.1109/TKDE.2020.3029582.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Matrix decomposition is one of the fundamental tools to discover knowledge from big data generated by modern applications. However, it is still inefficient or infeasible to process very big data using such a method in a single machine. Moreover, big data are often distributedly collected and stored on different machines. Thus, such data generally bear strong heterogeneous noise. It is essential and useful to develop distributed matrix decomposition for big data analytics. Such a method should scale up well, model the heterogeneous noise, and address the communication issue in a distributed system. To this end, we propose a distributed Bayesian matrix decomposition model (DBMD) for big data mining and clustering. Specifically, we adopt three strategies to implement the distributed computing including 1) the accelerated gradient descent, 2) the alternating direction method of multipliers (ADMM), and 3) the statistical inference. We investigate the theoretical convergence behaviors of these algorithms. To address the heterogeneity of the noise, we propose an optimal plug-in weighted average that reduces the variance of the estimation. Synthetic experiments validate our theoretical results, and real-world experiments show that our algorithms scale up well to big data and achieves superior or competing performance compared to two typical distributed methods including Scalable-NMF and scalable k-means++.
Keyword:
Matrix decomposition
Bayes methods
Big Data
Principal component analysis
Distributed databases
Data mining
Clustering algorithms
Distributed algorithm
bayesian matrix decomposition
clustering
big data
data mining
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
10.4
论文数:
6.9K
被引数:
3.2W
机构
引用论文
.png){kind=icon}
Stability-driven nonnegative matrix factorization to interpret spatial gene expression and build local gene networks稳定性驱动的非负矩阵分解解释空间基因表达并构建局部基因网络OAAI
OAAI分享收藏Quantitative Performance Evaluation of Uncertainty-Aware Hybrid AADL Designs Using Statistical Model Checking使用统计模型检查对不确定性感知的混合AADL设计进行定量性能评估OAAI
OAAI分享收藏The solubility of calcite and aragonite in seawater at atmospheric pressure and 34.5 0 / 00 salinity
PREAI
分享收藏Group-Sparse SVD Models via L1- and L0-norm Penalties and their Applications in Biological Data基于L1和L0-norm惩罚的群稀疏SVD模型及其在生物数据中的应用
PREAI
分享收藏
查看更多内容