.png){kind=icon}
返回
Efficient Parallel Split Learning Over Resource-Constrained Wireless Edge Networks
.png){kind=icon}
OA
AI
DOI：10.1109/TMC.2024.3359040.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The increasingly deeper neural networks hinder the democratization of privacy-enhancing distributed learning, such as federated learning (FL), to resource-constrained devices. To overcome this challenge, in this paper, we advocate the integration of edge computing paradigm and parallel split learning (PSL), allowing multiple edge devices to offload substantial training workloads to an edge server via layer-wise model split. By observing that existing PSL schemes incur excessive training latency and a large volume of data transmissions, we propose an innovative PSL framework, namely, efficient parallel split learning (EPSL), to accelerate model training. To be specific, EPSL parallelizes client-side model training and reduces the dimension of activations' gradients for backpropagation (BP) via last-layer gradient aggregation, leading to a significant reduction in server-side training and communication latency. Moreover, by considering the heterogeneous channel conditions and computing capabilities at edge devices, we jointly optimize subchannel allocation, power control, and cut layer selection to minimize the per-round latency. Simulation results show that the proposed EPSL framework significantly decreases the training latency needed to achieve a target accuracy compared with the state-of-the-art benchmarks, and the tailored resource management and layer split strategy can considerably reduce latency than the counterpart without optimization.
Keyword:
Computational modeling
Training
Resource management
Servers
Data models
Internet of Things
Optimization
Distributed learning
edge computing
edge intelligence
resource management
split learning
期刊
IF:
9.2
论文数:
5.9K
被引数:
1.8W
机构
引用论文
Adaptive Control of Local Updating and Model Compression for Efficient Federated Learning用于有效联邦学习的局部更新和模型压缩的自适应控制
.png){kind=icon}
PREAI
分享收藏In-Network Computation for Large-Scale Federated Learning Over Wireless Edge Networks无线边缘网络上大规模联邦学习的网络内计算OAAI
OAAI分享收藏Client Selection and Bandwidth Allocation in Wireless Federated Learning Networks: A Long-Term Perspective无线联合学习网络中的客户端选择和带宽分配: 长期观点OAAI
OAAI分享收藏Energy Efficient Federated Learning Over Heterogeneous Mobile Devices via Joint Design of Weight Quantization and Wireless Transmission通过权重量化和无线传输的联合设计在异构移动设备上实现节能的联邦学习OAAI
OAAI分享收藏
查看更多内容