.png){kind=icon}
返回
A Layer Selection Optimizer for Communication-Efficient Decentralized Federated Deep Learning
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2023.3251571.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Federated Learning (FL) systems orchestrate the cooperative training of a shared Machine Learning (ML) model across connected devices. Recently, decentralized FL architectures driven by consensus have been proposed to enable the devices to share and aggregate the ML model parameters via direct sidelink communications. The approach has the advantage of promoting the federation among the agents even in the absence of a server, but may require an intensive use of communication resources compared to vanilla FL methods. This paper proposes a communication-efficient design of consensus-driven FL optimized for training of Deep Neural Networks (DNNs). Devices independently select fragments of the DNN to be shared with neighbors on each training round. Selection is based on a local optimizer that trades model quality improvement with sidelink communication resource savings. The proposed technique is validated on a vehicular cooperative sensing use case characterized by challenging real-world datasets and complex DNNs typically employed in autonomous driving with up to 40 trainable layers. The impact of layer selection is analyzed under different distributed coordination configurations. The results show that it is better to prioritize the DNN layers possessing few parameters, while the selection policy should optimally balance gradient sorting and randomization. Latency, accuracy and communication tradeoffs are analyzed in detail targeting sustainable federation policies.
Keyword:
Federated learning
Artificial neural networks
Optimization
Deep learning
Computational modeling
Wireless sensor networks
5G mobile communication
Machine learning over networks
federated learning
consensus
sidelink communications
beyond 5G
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
A Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problems6g无线系统的愿景: 应用，趋势，技术和开放研究问题.png)
IEEE NETWORK
OAAI
IEEE NETWORKIF6.3
OAAI分享收藏Pressure-Based Bioassay Perceived by a Flexible Pressure Sensor with Synergistic Enhancement of the Photothermal Effect通过具有协同增强光热效应的柔性压力传感器感知的基于压力的生物测定
PREAI
分享收藏
查看更多内容