.png){kind=icon}
返回
Distributed Principal Subspace Analysis for Partitioned Big Data: Algorithms, Analysis, and Implementation
.png){kind=icon}
OA
AI
DOI：10.1109/TSIPN.2021.3122297.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Principal Subspace Analysis (PSA)-and its sibling, Principal Component Analysis (PCA)-is one of the most popular approaches for dimensionality reduction in signal processing and machine learning. But centralized PSA/PCA solutions are fast becoming irrelevant in the modern era of Big Data, in which the number of samples and/or the dimensionality of samples often exceed the storage and/or computational capabilities of individual machines. This has led to the study of distributed PSA/PCA solutions, in which the data are partitioned across multiple machines and an estimate of the principal subspace is obtained through collaboration among the machines. It is in this vein that this paper revisits the problem of distributed PSA/PCA under the general framework of an arbitrarily connected network of machines that lacks a central server. The main contributions of the paper in this regard are threefold. First, two algorithms are proposed in the paper that can be used for distributed PSA/PCA, with one in the case of data partitioned across samples and the other in the case of data partitioned across (raw) features. Second, in the case of sample-wise partitioned data, the proposed algorithm and a variant of it are analyzed, and their convergence to the true subspace at linear rates is established. Third, extensive experiments on both synthetic and real-world data are carried out to validate the usefulness of the proposed algorithms. In particular, in the case of sample-wise partitioned data, an MPI-based distributed implementation is carried out to study the interplay between network topology and communications cost as well as to study the effects of straggler machines on the proposed algorithms.
Keyword:
Distributed data
orthogonal iteration
principal component analysis
principal subspace
straggler effect
期刊
IF:
4.9
论文数:
734
被引数:
1.9K
机构
引用论文
分享收藏Emulsion liquid membrane extraction of lactic acid from aqueous solutions and fermentation broth
PREAI
分享收藏Use of gel chromatography for the determination of the Stokes radii of proteins in the presence and absence of detergents. A reexamination.png)
Biochemistry
BiochemistryIF0
PREAI
分享收藏Do Perceptions of Competence Mediate The Relationship Between Fundamental Motor Skill Proficiency and Physical Activity Levels of Children in Kindergarten?能力的感知是否可以介导幼儿园儿童的基本运动技能熟练程度与身体活动水平之间的关系？
PREAI
分享收藏
查看更多内容