Federated Semantic Learning Driven by Information Bottleneck for Task-Oriented Communications

doi:10.1109/LCOMM.2023.3307096

Federated Semantic Learning Driven by Information Bottleneck for Task-Oriented Communications

2023-10-01

7

PRE

AI

DOI：10.1109/LCOMM.2023.3307096

Original

Original request for help

Save

Abstract

En 中文

In this letter, we present a novel federated semantic learning (FedSem) framework to collaboratively train the semantic-channel encoders of multiple devices with the coordination of a base station-based semantic-channel decoder, which is more practical for task-oriented communications rather than performing the vanilla distributed learning merely at the user's side. Particularly, one of the most potential tasks, i.e., constructing semantic knowledge graph (SKG), is considered due to its powerful semantic structured representation and cross-modal comprehension capacity. In this case, the proposed FedSem can make full use of the distributed data and computing resources while protecting user privacy to directly parse images into SKGs. Furthermore, the information bottleneck theory is leveraged to drive the loss design by formalizing a rate-distortion tradeoff, which eliminates the redundancies of semantic features while maintaining the task-relevant information. Compared to the baselines, simulation results demonstrate that the proposed FedSem achieves better rate-distortion performance and convergence under different number of users and channel conditions.

Keywords:

Semantics

Task analysis

Transmitters

Receivers

Training

Feature extraction

Decoding

Federated semantic learning

information bottleneck

semantic knowledge graph

task-oriented communications

Federated Semantic Learning Driven by Information Bottleneck for Task-Oriented Communications

Abstract

Journal

Organization