arrow
返回

Accelerating Wireless Distributed Learning via Hybrid Split and Federated Learning Optimization

delete2026-03-13
delete0
PRE
AI
郭坤 (Kun Guo)
X
Xuefei Li
X
Xijun Wang
H
Howard H. Yang
W
Wei Feng
T
Tony Q. S. Quek
DOI:10.1109/tmc.2026.3673745delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Federated learning (FL) and split learning (SL) are two effective distributed learning paradigms in wireless networks, enabling collaborative model training across mobile devices without sharing raw data. While FL supports low-latency parallel training, it may converge to less accurate model. In contrast, SL achieves higher accuracy through sequential training but suffers from increased delay. To leverage the advantages of both, hybrid split and federated learning (HSFL) allows some devices to operate in FL mode and others in SL mode. This paper aims to accelerate HSFL by addressing three key questions: 1) How does learning mode selection affect overall learning performance? 2) How does it interact with batch size? 3) How can these hyperparameters be jointly optimized alongside communication and computational resources to reduce overall learning delay? We first analyze convergence, revealing the interplay between learning mode and batch size. Next, we formulate a delay minimization problem and propose a two-stage solution: a block coordinate descent method for a relaxed problem to obtain a locally optimal solution, followed by a rounding algorithm to recover integer batch sizes with near-optimal performance. Experimental results demonstrate that our approach significantly accelerates convergence to the target accuracy compared to existing methods.
Keyword:
Federated learning
split learning
leaning mode selection
batch size optimization
model splitting

期刊

IEEE Transactions on Mobile Computing 封面图
IEEE Transactions on Mobile Computing
IF:
9.2
论文数:
5.6K
被引数:
1.8W

机构

S
singapore university of technology and design
学者数:
282
论文数: 219
被引数: 0
E
east china normal university
学者数:
3.1W
论文数: 2.1W
被引数: 25
T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
S
Sun Yat-Sen University
学者数:
1.1W
论文数: 3.0K
被引数: 0
Z
zhejiang university
学者数:
17.7W
论文数: 12.1W
被引数: 152
学者 查看更多机构
引用论文

引用论文

HiveMind: Towards Cellular Native Machine Learning Model Splitting
err2022-02-01
err38
PREAI
errWang, Song; Zhang, Xinyu; Uchiyama, Hiromasa; Matsuda, Hiroki
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容