.png){kind=icon}
返回
Asynchronous Federated Learning Over Wireless Communication Networks
.png){kind=icon}
PRE
AI
DOI：10.1109/TWC.2022.3153495.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The conventional federated learning (FL) framework usually assumes synchronous reception and fusion of all the local models at the central aggregator and synchronous updating and training of the global model at all the agents as well. However, in a wireless network, due to limited radio resource, inevitable transmission failures and heterogeneous computing capacity, it is very hard to realize strict synchronization among all the involved user equipments (UEs). In this paper, we propose a novel asynchronous FL framework, which well adapts to the heterogeneity of users, communication environments and learning tasks, by considering both the possible delays in training and uploading the local models and the resultant staleness among the received models that has heavy impact on the global model fusion. A novel centralized fusion algorithm is designed to determine the fusion weight during the global update, which aims to make full use of the fresh information contained in the uploaded local models while avoiding the biased convergence by enforcing the impact of each UE's local dataset to be proportional to its sample share. Numerical experiments validate that the proposed asynchronous FL framework can achieve fast and smooth convergence and enhance the training efficiency significantly.
Keyword:
Training
Wireless communication
Convergence
Computational modeling
Adaptation models
Optimization
Collaborative work
Asynchronous federated learning
model fusion
model staleness
distributed learning
期刊
IF:
10.7
论文数:
1.3W
被引数:
5.3W
机构
引用论文
.png){kind=icon}
An unusual selectivity in Pd catalyzed cross-coupling of terminal alkynes with “Unactivated” alkynes
OAAI
OAAI分享收藏FedSA: A Semi-Asynchronous Federated Learning Mechanism in Heterogeneous Edge ComputingFedSA: 异构边缘计算中的半异步联邦学习机制
OAAI
OAAI分享收藏分享收藏SAFA: A Semi-Asynchronous Protocol for Fast Federated Learning With Low OverheadSAFA: 一种低开销快速联邦学习的半异步协议OAAI
OAAI分享收藏分享收藏分享收藏
查看更多内容