arrow
Return

An Efficient Joint Source-Channel Coding Scheme for Wireless Hierarchical Federated Learning and its Information-Theoretic Analysis

delete2024-11-01
delete0
PRE
AI
H
Haonan Zhang
K
Ke Li *
K
Kangli Zhao
P
Peng Xu
B
Bin Dai
DOI:10.1109/TCE.2024.3432178delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Wireless hierarchical federated learning (WHFL) is an implementation of wireless federated learning (WFL) on a cloud-edge-client hierarchical architecture that accelerates model training and achieves more favorable trade-offs between communication and computation. However, the unreliable wireless channel causes aggregation distortion and transmission latency, which significantly influence the learning performance of WHFL. To solve these problems, this paper proposes a feedback oriented joint source-channel coding (FO-JSCC) scheme for the multiple-input multiple-output (MIMO) WHFL system, which exploits channel output feedback, and provides significant improvements in gradient distortion under fixed coding blocklength or in transmission latency under target gradient distortion. Besides this, we analyze the impact of gradient distortion on the convergence rate and learning efficiency of WHFL. Simulation results show that our proposed scheme reduces model gradient distortion and enhances learning performance, and the transmission latency of our proposed scheme is about 2-4 times lower than that of traditional coding schemes.
Keywords:
Servers
Wireless communication
Encoding
Distortion
Wireless sensor networks
Federated learning
Communication system security
Channel feedback
hierarchical federated learning
joint source-channel coding
wireless edge computing

Journal

IEEE Transactions on Consumer Electronics cover
IEEE Transactions on Consumer Electronics
IF:
10.9
Papers:
5.1K
Citations:
6.8K

Organization

S
Southwest Jiaotong University
Scholars:
2.9W
Papers: 2.1W
Citations: 2.3W
C
chongqing university of posts & telecommunications
Scholars:
6.7K
Papers: 5.3K
Citations: 5