arrow
Return

Learning-Driven Decentralized Machine Learning in Resource-Constrained Wireless Edge Computing

delete2021-05-10
delete20
PRE
AI
Z
Zeyu Meng
徐
徐宏力 (Hongli Xu)
陈
陈敏 (Min Chen)
Y
Yang Xu *
Y
Yangming Zhao
C
Chunming Qiao
DOI:10.1109/INFOCOM42981.2021.9488817delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Data generated at the network edge can be processed locally by leveraging the paradigm of edge computing. To fully utilize the widely distributed data, we concentrate on a wireless edge computing system that conducts model training using decentralized peer-to-peer (P2P) methods. However, there are two major challenges on the way towards efficient P2P model training: limited resources (e.g., network bandwidth and battery life of mobile edge devices) and time-varying network connectivity due to device mobility or wireless channel dynamics, which have received less attention in recent years. To address these two challenges, this paper adaptively constructs a dynamic and efficient P2P topology, where model aggregation occurs at the edge devices. In a nutshell, we first formulate the topology construction for P2P learning (TCPL) problem with resource constraints as an integer programming problem. Then a learning-driven method is proposed to adaptively construct a topology at each training epoch. We further give the convergence analysis on training machine learning models even with non-convex loss functions. Extensive simulation results show that our proposed method can improve the model training efficiency by about 11% with resource constraints and reduce the communication cost by about 30% under the same accuracy requirement compared to the benchmarks.
Keywords:
Edge Computing
Distributed Machine Learning
Peer-to-Peer
Resource Allocation

Journal

I
IEEE Conference on Computer Communications and IEEE INFOCOM
IF:
0
Papers:
29
Citations:
0

Organization

U
university of science & technology of china, cas
Scholars:
3.2W
Papers: 2.7W
Citations: 74
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing
err2019-08-01
err1.2K
errOAAI
errZhou, Zhi; Chen, Xu; Li, En; Zeng, Liekang; Luo, Ke; Zhang, Junshan
errShare
errSave
Viral oncogenes
errCell
IF0
err1985-08-01
err0
PREAI
errJ BISHOP
errShare
errSave
Brain transcranial direct current stimulation modulates motor excitability in mice
err2010-02-15
err0
PREAI
errMarco Cambiaghi; Svetla Velikova; Javier J. Gonzalez‐Rosa; Marco Cursi; Giancarlo Comi; Letizia Leocani
errShare
errSave
Optimal Online Data Partitioning for Geo-Distributed Machine Learning in Edge of Wireless Networks
err2019-10-01
err45
PREAI
errLyu, Xinchen; Ren, Chenshan; Ni, Wei; Tian, Hui; Liu, Ren Ping; Dutkiewicz, Eryk
errShare
errSave
errShare
errSave
Selective observation of the two oxygen atoms at different sites in the carboxyl group (–COOH) of liquid acetic acid
err2009-01-01
err0
PREAI
errTakashi Tokushima; Yuka Horikawa; Yoshihisa Harada; Osamu Takahashi; Atsunari Hiraya; Shik Shin
errShare
errSave
Consensus and cooperation in networked multi-agent systems
err2007-01-01
err8.2K
PREAI
errOlfati-Saber, Reza; Fax, J. Alex; Murray, Richard M.
errShare
errSave
researcher View more