返回
Accelerating Wireless Distributed Learning via Hybrid Split and Federated Learning Optimization
DOI:10.1109/tmc.2026.3673745.png)
摘要
En 中文
Federated learning (FL) and split learning (SL) are two effective distributed learning paradigms in wireless networks, enabling collaborative model training across mobile devices without sharing raw data. While FL supports low-latency parallel training, it may converge to less accurate model. In contrast, SL achieves higher accuracy through sequential training but suffers from increased delay. To leverage the advantages of both, hybrid split and federated learning (HSFL) allows some devices to operate in FL mode and others in SL mode. This paper aims to accelerate HSFL by addressing three key questions: 1) How does learning mode selection affect overall learning performance? 2) How does it interact with batch size? 3) How can these hyperparameters be jointly optimized alongside communication and computational resources to reduce overall learning delay? We first analyze convergence, revealing the interplay between learning mode and batch size. Next, we formulate a delay minimization problem and propose a two-stage solution: a block coordinate descent method for a relaxed problem to obtain a locally optimal solution, followed by a rounding algorithm to recover integer batch sizes with near-optimal performance. Experimental results demonstrate that our approach significantly accelerates convergence to the target accuracy compared to existing methods.
Keyword:
Federated learning
split learning
leaning mode selection
batch size optimization
model splitting
期刊
IF:
9.2
论文数:
5.6K
被引数:
1.8W
机构
引用论文
Efficient Parallel Split Learning Over Resource-Constrained Wireless Edge Networks资源受限无线边缘网络上的高效并行分裂学习
Learning From Your Neighbours: Mobility-Driven Device-Edge-Cloud Federated Learning学习邻居:移动驱动的设备-边缘-云联邦学习
PipeSFL: a fine-grained parallelization framework for split federated learning on heterogeneous clientsPipeSFL:一种面向异构客户端分裂联邦学习的细粒度并行化框架
Trustworthy Blockchain-Assisted Federated Learning: Decentralized Reputation Management and Performance Optimization值得信赖的区块链辅助联邦学习: 去中心化声誉管理和性能优化

