arrow
Return

Joint Sensing and Semantic Communications with Multi-Task Deep Learning

delete2024-09-01
delete0
delete
OA
AI
Y
Yalin E. Sagduyu *
T
Tugba Erpek
A
Aylin Yener
Ş
Şennur Ulukuş
DOI:10.1109/MCOM.002.2300640delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This article explores the integration of deep learning techniques for joint sensing and communications, with an extension to semantic communications. The integrated system comprises a transmitter and receiver operating over a wireless channel, subject to noise and fading. The transmitter employs a deep neural network (DNN), namely an encoder, for joint operations of source coding, channel coding, and modulation, while the receiver utilizes another DNN, namely a decoder, for joint operations of demodulation, channel decoding, and source decoding to reconstruct the data samples. The transmitted signal serves a dual purpose, supporting communication with the receiver and enabling sensing. When a target is present, the reflected signal is received, and another DNN decoder is utilized for sensing. This decoder is responsible for detecting the target's presence and determining its range. All these DNNs, including one encoder and two decoders, undergo joint training through multi-task learning, considering data, and channel characteristics. This article extends to semantic communications another decoder at the receiver operating as a task classifier. This decoder evaluates the fidelity of label classification for received signals, enhancing the integration of semantics within the communication process. The study presents results based on using the CIFAR-10 as the input data and accounting for channel effects, like additive white Gaussian noise (AWGN) and Rayleigh fading. The results underscore the effectiveness of multi-task deep learning in achieving high-fidelity joint sensing and semantic communications.
Keywords:
Deep learning
Wireless communication
Wireless sensor networks
Transmitters
Semantics
Receivers
Artificial neural networks
Integrated sensing and communication

Journal

IEEE Communications Magazine cover
IEEE Communications Magazine
IF:
8.2
Papers:
6.9K
Citations:
2.2W

Organization

U
University System of Ohio
Scholars:
15.4W
Papers: 13.0W
Citations: 200
University System of Maryland cover
University System of Maryland
Scholars:
6.4W
Papers: 5.6W
Citations: 113
O
Ohio State University
Scholars:
4.1W
Papers: 3.2W
Citations: 80
researcher View more organizations