arrow
返回

FedAND: Federated Learning Exploiting Consensus ADMM by Nulling Drift

delete2024-07-01
delete1
PRE
AI
H
H. J. Kang
M
Minsoo Kim
B
B Lee
H
Hongseok Kim *
DOI:10.1109/TII.2024.3380742delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this article, we propose FedAND, a unified federated learning optimization algorithm, to tackle client drift and server drift issues under partial client participation. Federated learning is gaining popularity due to privacy concerns and mobile computing, but it still faces challenges due to heterogeneous and distributed data. FedAND leverages consensus alternating direction method of multipliers (ADMM) and resolves the server drift caused by the server state in the global update. Under partial participation, we prove that FedAND preserves the strong convergence properties of ADMM while suppressing the server drift, which in turn reduces the client drift and thus achieves better convergence. Our empirical results demonstrate superior performance compared to other methods such as FedProx, FedADMM, FedPD, and FedDyn in diverse scenarios of statistical and system heterogeneity under partial client participation.
Keyword:
Consensus alternating direction method of multipliers (ADMM)
distributed optimization
federated learning
heterogeneity

期刊

IEEE Transactions on Industrial Informatics 封面图
IEEE Transactions on Industrial Informatics
IF:
9.9
论文数:
8.6K
被引数:
6.0W

机构

S
Sogang University
学者数:
4.6K
论文数: 4.4K
被引数: 4.0K
引用论文

引用论文

Effect of betulin and betulonic acid on isolated rat liver mitochondria and liposomes
err2020-10-01
err0
PREAI
errMikhail V. Dubinin; Alena A. Semenova; Anna I. Ilzorkina; Irina B. Mikheeva; Valery A. Yashin; Nikita V. Penkov; Valentina A. Vydrina; Gumer Yu. Ishmuratov; Vyacheslav A. Sharapov; Ekaterina I. Khoroshavina; Sergey V. Gudkov; Konstantin N. Belosludtsev
err分享
err收藏
How high is a MoSe2 monolayer?
err2021-12-28
err0
PREAI
errMegan Cowie; Rikke Plougmann; Yacine Benkirane; Léonard Schué; Zeno Schumacher; Peter Grütter
err分享
err收藏
A survey on federated learning关于联邦学习的调查
err2021-03-01
err671
PREAI
errZhang, Chen; Xie, Yu; Bai, Hang; Yu, Bin; Li, Weihong; Gao, Yuan
err分享
err收藏
Toward Personalized Federated Learning
err2023-12-01
err415
errOAAI
errTan, Alysa Ziying; Yu, Han; Cui, Lizhen; Yang, Qiang
err分享
err收藏
Federated Learning in Mobile Edge Networks: A Comprehensive Survey移动边缘网络中的联合学习: 综合调查
err2020-01-01
err1.3K
errOAAI
errLim, Wei Yang Bryan; Nguyen Cong Luong; Dinh Thai Hoang; Jiao, Yutao; Liang, Ying-Chang; Yang, Qiang; Niyato, Dusit; Miao, Chunyan
err分享
err收藏
err分享
err收藏
学者 查看更多内容