arrow
返回

Fedpower: privacy-preserving distributed eigenspace estimation

delete2024-09-26
delete0
PRE
AI
X
Xiao Guo
李翔 封面图
李翔 (Xiang Li)
X
Xiangyu Chang *
S
Shusen Wang
张志华 封面图
张志华 (Zhihua Zhang)
DOI:10.1007/s10994-024-06620-0delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Eigenspace estimation is a fundamental tool in data analytics, which has found applications in PCA, dimension reduction, and clustering, among others. The modern machine learning community usually involves data that come from and belong to different organizations. The low communication power and possible data privacy breaches make the eigenspace estimation challenging. To address these issues, we propose a class of algorithms called FedPower within the federated learning (FL) framework. FedPower leverages the well-known power method by alternating multiple local power iterations and a global aggregation step, thus improving communication efficiency. In the aggregation, we propose to weight each local eigenvector matrix with Orthogonal Procrustes Transformation (OPT) for better alignment. We add Gaussian noise in each iteration to ensure strong privacy protection by adopting the notion of differential privacy (DP). We provide convergence bounds for FedPower composed of different interpretable terms corresponding to the effects of Gaussian noise, parallelization, and random sampling of local machines. Additionally, we conduct experiments to demonstrate the effectiveness of our proposed algorithms.
Keyword:
Communication efficiency
Federated learning
Power method
Stragglers' effect

期刊

Machine Learning 封面图
Machine Learning
IF:
2.9
论文数:
2.7K
被引数:
3.4W

机构

X
xi'an jiaotong university
学者数:
9.3W
论文数: 6.7W
被引数: 75
U
university of pennsylvania
学者数:
9.2W
论文数: 7.8W
被引数: 153
N
northwest university xi'an
学者数:
1.8W
论文数: 1.2W
被引数: 22
P
peking university
学者数:
11.9W
论文数: 8.7W
被引数: 146
学者 查看更多机构
引用论文

引用论文

Sol-Gel Biopolymer/Silica Nanocomposites in Biotechnology
err2006-08-01
err0
PREAI
errThibaud Coradin; Joachim Allouche; Michel Boissiere; Jacques Livage
err分享
err收藏
Secure Federated Matrix Factorization安全的联邦矩阵分解
err2021-09-01
err206
errOAAI
errChai, Di; Wang, Leye; Chen, Kai; Yang, Qiang
err分享
err收藏
err分享
err收藏
Robust and Communication-Efficient Federated Learning From Non-i.i.d. Data
err2020-09-01
err1.0K
errOAAI
errSattler, Felix; Wiedemann, Simon; Mueller, Klaus-Robert; Samek, Wojciech
err分享
err收藏
Exposed! A Survey of Attacks on Private Data
err2017-03-07
err140
PREAI
errDwork, Cynthia; Smith, Adam; Steinke, Thomas; Ullman, Jonathan
err分享
err收藏
err分享
err收藏
学者 查看更多内容