arrow
Return

Learning-Driven Decentralized Machine Learning in Resource-Constrained Wireless Edge Computing

delete2021-05-10
delete20
PRE
AI
Z
Zeyu Meng
徐宏力 (Hongli Xu)
陈敏 (Min Chen)
Y
Yang Xu *
Y
Yangming Zhao
C
Chunming Qiao
DOI:10.1109/INFOCOM42981.2021.9488817delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Data generated at the network edge can be processed locally by leveraging the paradigm of edge computing. To fully utilize the widely distributed data, we concentrate on a wireless edge computing system that conducts model training using decentralized peer-to-peer (P2P) methods. However, there are two major challenges on the way towards efficient P2P model training: limited resources (e.g., network bandwidth and battery life of mobile edge devices) and time-varying network connectivity due to device mobility or wireless channel dynamics, which have received less attention in recent years. To address these two challenges, this paper adaptively constructs a dynamic and efficient P2P topology, where model aggregation occurs at the edge devices. In a nutshell, we first formulate the topology construction for P2P learning (TCPL) problem with resource constraints as an integer programming problem. Then a learning-driven method is proposed to adaptively construct a topology at each training epoch. We further give the convergence analysis on training machine learning models even with non-convex loss functions. Extensive simulation results show that our proposed method can improve the model training efficiency by about 11% with resource constraints and reduce the communication cost by about 30% under the same accuracy requirement compared to the benchmarks.
Keywords:
Edge Computing
Distributed Machine Learning
Peer-to-Peer
Resource Allocation

Journal

I
IEEE Conference on Computer Communications and IEEE INFOCOM
IF:
0
Papers:
29
Citations:
0

Organization

U
university of science & technology of china, cas
Scholars:
3.2W
Papers: 2.7W
Citations: 74
C
chinese academy of sciences
Scholars:
55.9W
Papers: 44.7W
Citations: 704