.png){kind=icon}
返回
Communication-Efficient Distributed Learning: An Overview
.png){kind=icon}
PRE
AI
DOI：10.1109/JSAC.2023.3242710.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Distributed learning is envisioned as the bedrock of next-generation intelligent networks, where intelligent agents, such as mobile devices, robots, and sensors, exchange information with each other or a parameter server to train machine learning models collaboratively without uploading raw data to a central entity for centralized processing. By utilizing the computation/communication capability of individual agents, the distributed learning paradigm can mitigate the burden at central processors and help preserve data privacy of users. Despite its promising applications, a downside of distributed learning is its need for iterative information exchange over wireless channels, which may lead to high communication overhead unaffordable in many practical systems with limited radio resources such as energy and bandwidth. To overcome this communication bottleneck, there is an urgent need for the development of communication-efficient distributed learning algorithms capable of reducing the communication cost and achieving satisfactory learning/optimization performance simultaneously. In this paper, we present a comprehensive survey of prevailing methodologies for communication-efficient distributed learning, including reduction of the number of communications, compression and quantization of the exchanged information, radio resource management for efficient learning, and game-theoretic mechanisms incentivizing user participation. We also point out potential directions for future research to further enhance the communication efficiency of distributed learning in various scenarios.
Keyword:
Distance learning
Computer aided instruction
Servers
Distributed databases
Sensors
Resource management
Training
Distributed learning
communication efficiency
event-triggering
quantization
compression
sparsification
resource allocation
incentive mechanisms
single-task learning
multitask learning
meta-learning
online learning
期刊
IF:
17.2
论文数:
6.4K
被引数:
3.1W
机构
引用论文
.png){kind=icon}
分享收藏
分享收藏Communication-Efficient Policy G ad en Methods for Distributed Reinforcement Learning用于分布式强化学习的通信高效策略和方法
OAAI
OAAI分享收藏Communication-Efficient Federated Deep Learning With Layerwise Asynchronous Model Update and Temporally Weighted Aggregation具有分层异步模型更新和时间加权聚合的高效通信联合深度学习OAAI
OAAI分享收藏
查看更多内容