arrow
Return

Dynamic Network-Assisted D2D-Aided Coded Distributed Learning

delete2023-06-01
delete2
delete
OA
AI
N
Nikita Zeulin *
O
Olga Galinina
N
Nageen Himayat
S
Sergey Andreev
R
Robert W. Heath
DOI:10.1109/TCOMM.2023.3259442delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
Today, numerous machine learning (ML) applications offer continuous data processing and real-time data analytics at the edge of wireless networks. Distributed real-time ML solutions are highly susceptible to the so-called straggler effect caused by resource heterogeneity, which can be mitigated by various computation offloading mechanisms that severely impact communication efficiency, especially in large-scale scenarios. To reduce the communication overhead, we leverage device-to-device (D2D) connectivity, which enhances spectrum utilization and allows for efficient data exchange between proximate devices. In particular, we design a novel D2D-aided coded distributed learning method named D2D-CDL for efficient load balancing across devices. The proposed solution captures system dynamics, including data (time-varying learning model, irregular intensity of data arrivals), device (diverse computational resources and volume of training data), and deployment (different locations and D2D graph connectivity). To decrease the number of communication rounds, we derive an optimal compression rate, which minimizes the processing time. The resulting optimization problem provides suboptimal compression parameters that improve the total training time. Our proposed method is particularly beneficial for real-time collaborative applications, where users continuously generate training data.
Keywords:
Computational modeling
Device-to-device communication
Training
Data models
Collaboration
Distance learning
Computer aided instruction
Online distributed learning
device-to-device communications
Index Terms
coded computing
data compression
load balancing

Journal

IEEE Transactions on Communications cover
IEEE Transactions on Communications
IF:
8.3
Papers:
1.2W
Citations:
3.6W

Organization

I
intel corporation
Scholars:
58
Papers: 22
Citations: 0
N
North Carolina State University
Scholars:
768
Papers: 346
Citations: 0
T
tampere university
Scholars:
452
Papers: 174
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

Security and Privacy in Device-to-Device (D2D) Communication: A Review
err2017-01-01
err213
PREAI
errHaus, Michael; Waqas, Muhammad; Ding, Aaron Yi; Li, Yong; Tarkoma, Sasu; Ott, Jorg
errShare
errSave
Pulpal and micro-organism responses to two experimental dental bonding systems
err1989-03-01
err0
PREAI
errR.L. Blosser; N.W. Rupp; H.R. Stanley; R.L. Bowen
errShare
errSave
The Disruptions of 5G on Data-Driven Technologies and Applications
err2020-06-01
err48
errOAAI
errLoghin, Dumitrel; Cai, Shaofeng; Chen, Gang; Tien Tuan Anh Dinh; Fan, Feiyi; Lin, Qian; Ng, Janice; Ooi, Beng Chin; Sun, Xutao; Quang-Trung Ta; Wang, Wei; Xiao, Xiaokui; Yang, Yang; Zhang, Meihui; Zhang, Zhonghua
errShare
errSave
Scheduling for Cellular Federated Edge Learning With Importance and Channel Awareness
err2020-11-01
err170
errOAAI
errRen, Jinke; He, Yinghui; Wen, Dingzhu; Yu, Guanding; Huang, Kaibin; Guo, Dongning
errShare
errSave
Convergence Time Optimization for Federated Learning Over Wireless Networks
err2021-04-01
err222
errOAAI
errChen, Mingzhe; Poor, H. Vincent; Saad, Walid; Cui, Shuguang
errShare
errSave
Switching Currents Limited by Single Phase Slips in One-Dimensional Superconducting Al Nanowires
err2011-09-21
err0
errOAAI
errPeng Li; Phillip M. Wu; Yuriy Bomze; Ivan V. Borzenets; Gleb Finkelstein; A. M. Chang
errShare
errSave
Effects of yoga breathing practice on heart rate variability in healthy adolescents: a randomized controlled trial
err2020-03-01
err0
errOAAI
errMaheshkumar Kuppusamy; Dilara Kamaldeen; Ravishankar Pitani; Julius Amaldas; Padmavathi Ramasamy; Poonguzhali Shanmugam; Venugopal Vijayakumar
errShare
errSave
researcher View more