.png){kind=icon}
.png){kind=icon}
Return
FedLC: Accelerating Asynchronous Federated Learning in Edge Computing
.png){kind=icon}
PRE
AI
DOI：10.1109/TMC.2023.3307610.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Federated Learning (FL) has been widely adopted to process the enormous data in the application scenarios like Edge Computing (EC). However, the commonly-used synchronous mechanism in FL may incur unacceptable waiting time for heterogeneous devices, leading to a great strain on the devices' constrained resources. In addition, the alternative asynchronous FL is known to suffer from the model staleness, which will lead to performance degradation of the trained model, especially on non-i.i.d. data. In this paper, we design a novel asynchronous FL mechanism, named FedLC, to handle the non-i.i.d. issue in EC by enabling the local collaboration among edge devices. Specifically, apart from uploading the local model directly to the server, each device will transmit its gradient to the other devices with different data distributions for local collaboration, which can improve the model generality. We theoretically analyze the convergence rate of FedLC and obtain the quantitative relationship between convergence bound and local collaboration. We design an efficient algorithm utilizing demand-list to determine the set of devices receiving gradients from each device. To handle the model staleness, we further assign different learning rates for various devices according to their participation frequency. The extensive experimental results demonstrate the effectiveness of our proposed mechanism.
Keywords:
Computational modeling
Servers
Collaboration
Data models
Training
Convergence
Synchronization
Asynchronous federated learning
edge computing
non-i.i.d
local collaboration
Journal
IF:
9.2
Papers:
5.6K
Citations:
1.8W