.png){kind=icon}
.png){kind=icon}
Return
Dynamic Network-Assisted D2D-Aided Coded Distributed Learning
.png){kind=icon}
OA
AI
DOI：10.1109/TCOMM.2023.3259442.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Today, numerous machine learning (ML) applications offer continuous data processing and real-time data analytics at the edge of wireless networks. Distributed real-time ML solutions are highly susceptible to the so-called straggler effect caused by resource heterogeneity, which can be mitigated by various computation offloading mechanisms that severely impact communication efficiency, especially in large-scale scenarios. To reduce the communication overhead, we leverage device-to-device (D2D) connectivity, which enhances spectrum utilization and allows for efficient data exchange between proximate devices. In particular, we design a novel D2D-aided coded distributed learning method named D2D-CDL for efficient load balancing across devices. The proposed solution captures system dynamics, including data (time-varying learning model, irregular intensity of data arrivals), device (diverse computational resources and volume of training data), and deployment (different locations and D2D graph connectivity). To decrease the number of communication rounds, we derive an optimal compression rate, which minimizes the processing time. The resulting optimization problem provides suboptimal compression parameters that improve the total training time. Our proposed method is particularly beneficial for real-time collaborative applications, where users continuously generate training data.
Keywords:
Computational modeling
Device-to-device communication
Training
Data models
Collaboration
Distance learning
Computer aided instruction
Online distributed learning
device-to-device communications
Index Terms
coded computing
data compression
load balancing
Journal
IF:
8.3
Papers:
1.2W
Citations:
3.6W
View more organizations