.png){kind=icon}
.png){kind=icon}
Return
Communication Efficient Distributed Learning Over Wireless Channels
.png){kind=icon}
OA
AI
DOI：10.1109/LSP.2023.3321561.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Vertically distributed learning exploits the local features collected by multiple learning workers to form a better global model. However, data exchange between the workers and the model aggregator for parameter training incurs a heavy communication burden, especially when the learning system is built upon capacity-constrained wireless networks. In this letter, we propose a novel hierarchical distributed learning framework, where each worker separately learns a low-dimensional embedding of their local observed data. Then, they perform communication-efficient distributed max-pooling to efficiently transmit the synthesized input to the aggregator. For data exchange over a shared wireless channel, we propose an opportunistic carrier sensing-based protocol to implement the max-pooling of the output of all the workers. Our simulation experiments show that the proposed learning framework is able to achieve almost the same model accuracy as the learning model using the concatenation of all the raw outputs from the learning workers while significantly reducing the communication load.
Keywords:
Wireless sensor networks
Wireless communication
Distance learning
Computer aided instruction
Distributed databases
Sensors
Training
Learning over wireless channels
max-pooling
opportunistic carrier sensing
vertically distributed learning
Journal
IF:
9.6
Papers:
1.1W
Citations:
1.7W