arrow
Return

Joint Task and Data-Oriented Semantic Communications: A Deep Separate Source-Channel Coding Scheme

delete2024-01-15
delete8
delete
OA
AI
J
Jianhao Huang
C
Chuan Huang *
X
Xiaoqi Qin
张玮 cover
张玮 (Wei Zhang)
DOI:10.1109/JIOT.2023.3293154delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Semantic communications are expected to accomplish various semantic tasks with relatively less spectrum resource by exploiting the semantic feature of source data. To simultaneously serve both the data transmission and semantic tasks, joint data compression and semantic analysis has become a pivotal issue in semantic communications. This article proposes a deep separate source-channel coding (DSSCC) framework for the joint task and data-oriented semantic communications (JTD-SCs) and utilizes the variational autoencoder approach to solve the rate-distortion problem with semantic distortion. First, by analyzing the Bayesian model of the DSSCC framework, we derive a novel rate-distortion optimization problem via the Bayesian inference approach for general data distributions and semantic tasks. Next, for a typical application of joint image transmission and classification, we combine the variational autoencoder approach with a forward adaption scheme to effectively extract image features and adaptively learn the density information of the obtained features. Finally, an iterative training algorithm is proposed to tackle the overfitting issue of deep learning models. Simulation results reveal that the proposed scheme achieves better coding gain as well as data recovery and classification performance in most scenarios, compared to the classical compression schemes and the emerging deep joint source-channel schemes.
Keywords:
Deep learning
rate-distortion theory
semantic communications
separate source-channel coding
variational autoencoder

Journal

IEEE Internet of Things Journal cover
IEEE Internet of Things Journal
IF:
8.9
Papers:
1.4W
Citations:
7.8W

Organization

B
beijing university of posts & telecommunications
Scholars:
1.4W
Papers: 1.2W
Citations: 9
T
The Chinese University of Hong Kong, Shenzhen
Scholars:
4.3K
Papers: 4.0K
Citations: 7
Cited Papers

Cited Papers

Evaluating more naturalistic outcome measures
err2015-12-01
err0
errOAAI
errRiley Bove; Charles C. White; Gavin Giovannoni; Bonnie Glanz; Victor Golubchikov; Johnny Hujol; Charles Jennings; Dawn Langdon; Michelle Lee; Anna Legedza; James Paskavitz; Sashank Prasad; John Richert; Allison Robbins; Susan Roberts; Howard Weiner; Ravi Ramachandran; Martyn Botfield; Philip L. De Jager
errShare
errSave
Nonlinear Transform Coding
err2021-02-01
err77
errOAAI
errBalle, Johannes; Chou, Philip A.; Minnen, David; Singh, Saurabh; Johnston, Nick; Agustsson, Eirikur; Hwang, Sung Jin; Toderici, George
errShare
errSave
Internet of Things in the 5G Era: Enablers, Architecture, and Business Models
err2016-03-01
err979
errOAAI
errPalattella, Maria Rita; Dohler, Mischa; Grieco, Alfredo; Rizzo, Gianluca; Torsner, Johan; Engel, Thomas; Ladid, Latif
errShare
errSave
2-D Material Molybdenum Disulfide Analyzed by XPS
err2014-07-09
err0
PREAI
errD. Ganta; S. Sinha; Richard T. Haasch
errShare
errSave
ImageNet Classification with Deep Convolutional Neural Networks
err2017-05-24
err8.3W
errOAAI
errKrizhevsky, Alex; Sutskever, Ilya; Hinton, Geoffrey E.
errShare
errSave
researcher View more