返回
SL-ACC: A Communication-Efficient Split Learning Framework With Adaptive Channel-Wise Compression
DOI:10.1109/tvt.2026.3679518.png)
摘要
En 中文
The increasing complexity of neural networks poses a significant barrier to the deployment of distributed machine learning (ML) on resource-constrained devices, such as federated learning (FL). Split learning (SL) offers a promising solution by offloading the primary computing load from edge devices to a server via model partitioning. However, as the number of participating devices increases, the transmission of excessive smashed data (i.e., activations and gradients) becomes a major bottleneck for SL, slowing down the model training. To tackle this challenge, we propose a communication-efficient SL framework, named SL-ACC, which comprises two key components: adaptive channel importance identification (ACII) and channel grouping compression (CGC). ACII first identifies the contribution of each channel in the smashed data to model training using Shannon entropy. Following this, CGC groups the channels based on their entropy and performs group-wise adaptive compression to shrink the transmission volume without compromising training accuracy. Extensive experiments across various datasets validate that our proposed SL-ACC framework takes considerably less time to achieve a target accuracy than state-of-the-art benchmarks.
Keyword:
Distributed learning
edge intelligence
split learning
期刊
IF:
7.1
论文数:
1.8W
被引数:
6.6W
机构
引用论文
AdaptSFL: Adaptive Split Federated Learning in Resource-Constrained Edge NetworksAdaptSFL: 资源受限边缘网络中的自适应分裂联邦学习
Efficient Parallel Split Learning Over Resource-Constrained Wireless Edge Networks资源受限无线边缘网络上的高效并行分裂学习
Reinforcement Learning for Joint Optimization of Communication and Computation in Vehicular Networks
Joint Source-Channel Coding for Image Super-Resolution Tasks in Semantic Communications语义通信中图像超分辨率任务的联合源通道编码

