arrow
返回

Communication Efficient Distributed Learning Over Wireless Channels

delete2023-01-01
delete0
delete
OA
AI
I
Idan Achituve
W
Wenbo Wang
E
Ethan Fetaya
A
Amir Leshem *
DOI:10.1109/LSP.2023.3321561delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Vertically distributed learning exploits the local features collected by multiple learning workers to form a better global model. However, data exchange between the workers and the model aggregator for parameter training incurs a heavy communication burden, especially when the learning system is built upon capacity-constrained wireless networks. In this letter, we propose a novel hierarchical distributed learning framework, where each worker separately learns a low-dimensional embedding of their local observed data. Then, they perform communication-efficient distributed max-pooling to efficiently transmit the synthesized input to the aggregator. For data exchange over a shared wireless channel, we propose an opportunistic carrier sensing-based protocol to implement the max-pooling of the output of all the workers. Our simulation experiments show that the proposed learning framework is able to achieve almost the same model accuracy as the learning model using the concatenation of all the raw outputs from the learning workers while significantly reducing the communication load.
Keyword:
Wireless sensor networks
Wireless communication
Distance learning
Computer aided instruction
Distributed databases
Sensors
Training
Learning over wireless channels
max-pooling
opportunistic carrier sensing
vertically distributed learning

期刊

IEEE Signal Processing Magazine 封面图
IEEE Signal Processing Magazine
IF:
9.6
论文数:
1.1W
被引数:
1.7W

机构

B
Bar Ilan University
学者数:
9.7K
论文数: 8.5K
被引数: 59
引用论文

引用论文

Effects of lunar phases on short-term, explosive physical performance among young trained athletes
err2018-01-25
err0
PREAI
errNarimen Yousfi; Mohamed Arbi Mejri; Mehdi Rouissi; Amri Hammami; Montassar Tabben; Anis Chaouachi; Monoem Haddad; Karim Chamari
err分享
err收藏
Analyzing and Troubleshooting Single-Screw Extruders
err
IF0
err2020-04-20
err0
PREAI
errGregory A. Campbell; Mark A. Spalding
err分享
err收藏
Pulsed growth of fungal hyphal tips.
err1994-12-06
err0
errOAAI
errR López-Franco; S Bartnicki-Garcia; C E Bracker
err分享
err收藏
Comparison between Binary and Decimal Floating-Point Numbers
err2016-07-01
err6
errOAAI
errBrisebarre, Nicolas; Lauter, Christoph; Mezzarobba, Marc; Muller, Jean-Michel
err分享
err收藏
Dynamics of friction: superlubric state
err1993-03-01
err0
PREAI
errKazumasa Shinjo; Motohisa Hirano
err分享
err收藏
SecureBoost: A Lossless Federated Learning Framework
err2021-11-01
err230
errOAAI
errCheng, Kewei; Fan, Tao; Jin, Yilun; Liu, Yang; Chen, Tianjian; Papadopoulos, Dimitrios; Yang, Qiang
err分享
err收藏
学者 查看更多内容