arrow
Return

Adaptive Federated Learning in Resource Constrained Edge Computing Systems

delete2019-06-01
delete1.4K
delete
OA
AI
S
Shiqiang Wang *
T
Tiffany Tuor
T
Theodoros Salonidis
K
Kin K. Leung
C
Christian Makaya
T
Ting He
K
Kevin Chan
DOI:10.1109/JSAC.2019.2904348delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Emerging technologies and applications including Internet of Things, social networking, and crowd-sourcing generate large amounts of data at the network edge. Machine learning models are often built from the collected data, to enable the detection, classification, and prediction of future events. Due to bandwidth, storage, and privacy concerns, it is often impractical to send all the data to a centralized location. In this paper, we consider the problem of learning model parameters from data distributed across multiple edge nodes, without sending raw data to a centralized place. Our focus is on a generic class of machine learning models that are trained using gradient-descent-based approaches. We analyze the convergence bound of distributed gradient descent from a theoretical point of view, based on which we propose a control algorithm that determines the best tradeoff between local update and global parameter aggregation to minimize the loss function under a given resource budget. The performance of the proposed algorithm is evaluated via extensive experiments with real datasets, both on a networked prototype system and in a larger-scale simulated environment. The experimentation results show that our proposed approach performs near to the optimum with various machine learning models and different data distributions.
Keywords:
Distributed machine learning
federated learning
mobile edge computing
wireless networking
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Journal on Selected Areas in Communications cover
IEEE Journal on Selected Areas in Communications
IF:
17.2
Papers:
6.4K
Citations:
3.1W

Organization

P
Pennsylvania State University
Scholars:
3.0W
Papers: 2.6W
Citations: 7.2W
I
international business machines (ibm)
Scholars:
5.7K
Papers: 4.5K
Citations: 4
P
pennsylvania commonwealth system of higher education (pcshe)
Scholars:
12.9W
Papers: 11.7W
Citations: 177
I
Imperial College London
Scholars:
8.3W
Papers: 7.3W
Citations: 11.1W
researcher View more organizations