FedLC: Accelerating Asynchronous Federated Learning in Edge Computing

Yang Xu

doi:10.1109/TMC.2023.3307610

Return

FedLC: Accelerating Asynchronous Federated Learning in Edge Computing

2024-05-01

PRE

DOI：10.1109/TMC.2023.3307610

Original

Original request for help

Save

Abstract

En 中文

Federated Learning (FL) has been widely adopted to process the enormous data in the application scenarios like Edge Computing (EC). However, the commonly-used synchronous mechanism in FL may incur unacceptable waiting time for heterogeneous devices, leading to a great strain on the devices' constrained resources. In addition, the alternative asynchronous FL is known to suffer from the model staleness, which will lead to performance degradation of the trained model, especially on non-i.i.d. data. In this paper, we design a novel asynchronous FL mechanism, named FedLC, to handle the non-i.i.d. issue in EC by enabling the local collaboration among edge devices. Specifically, apart from uploading the local model directly to the server, each device will transmit its gradient to the other devices with different data distributions for local collaboration, which can improve the model generality. We theoretically analyze the convergence rate of FedLC and obtain the quantitative relationship between convergence bound and local collaboration. We design an efficient algorithm utilizing demand-list to determine the set of devices receiving gradients from each device. To handle the model staleness, we further assign different learning rates for various devices according to their participation frequency. The extensive experimental results demonstrate the effectiveness of our proposed mechanism.

Keywords:

Computational modeling

Servers

Collaboration

Data models

Training

Convergence

Synchronization

Asynchronous federated learning

edge computing

non-i.i.d

local collaboration