返回
FedAND: Federated Learning Exploiting Consensus ADMM by Nulling Drift
DOI:10.1109/TII.2024.3380742.png)
摘要
En 中文
In this article, we propose FedAND, a unified federated learning optimization algorithm, to tackle client drift and server drift issues under partial client participation. Federated learning is gaining popularity due to privacy concerns and mobile computing, but it still faces challenges due to heterogeneous and distributed data. FedAND leverages consensus alternating direction method of multipliers (ADMM) and resolves the server drift caused by the server state in the global update. Under partial participation, we prove that FedAND preserves the strong convergence properties of ADMM while suppressing the server drift, which in turn reduces the client drift and thus achieves better convergence. Our empirical results demonstrate superior performance compared to other methods such as FedProx, FedADMM, FedPD, and FedDyn in diverse scenarios of statistical and system heterogeneity under partial client participation.
Keyword:
Consensus alternating direction method of multipliers (ADMM)
distributed optimization
federated learning
heterogeneity
期刊
IF:
9.9
论文数:
8.6K
被引数:
6.0W
机构
引用论文
Recent Progress in Sensor Arrays: From Construction Principles of Sensing Elements to Applications传感器阵列的最新进展: 从传感元件的构造原理到应用
ACS Sensors
IF0

