arrow
Return

Semantic Communication With Memory

delete2023-08-01
delete10
delete
OA
AI
H
Huiqiang Xie
Z
Zhijin Qin *
G
Geoffrey Ye Li
DOI:10.1109/JSAC.2023.3288236delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
While semantic communication succeeds in efficiently transmitting due to the strong capability to extract the essential semantic information, it is still far from the intelligent or human-like communications. In this paper, we introduce an essential component, memory, into semantic communications to mimic human communications. Particularly, we investigate a deep learning (DL) based semantic communication system with memory, named Mem-DeepSC, by considering the scenario question answer task. We exploit the universal Transformer based transceiver to extract the semantic information and introduce the memory module to process the context information. Moreover, we derive the relationship between the length of semantic signal and the channel noise to validate the possibility of dynamic transmission. Specially, we propose two dynamic transmission methods to enhance the transmission reliability as well as to reduce the communication overheads by masking some unessential elements, which are recognized through training the model with mutual information. Numerical results show that the proposed Mem-DeepSC is superior to benchmarks in terms of answer accuracy and transmission efficiency, i.e., number of transmitted symbols.
Keywords:
Semantic communications
memory task
dynamic transmission
deep learning

Journal

IEEE Journal on Selected Areas in Communications cover
IEEE Journal on Selected Areas in Communications
IF:
17.2
Papers:
6.4K
Citations:
3.1W

Organization

T
tsinghua university
Scholars:
11.9W
Papers: 10.0W
Citations: 137
Q
Queen Mary University London
Scholars:
2.0W
Papers: 1.5W
Citations: 327
U
university of london
Scholars:
21.5W
Papers: 19.7W
Citations: 305
researcher View more organizations
Cited Papers

Cited Papers

Evaluating more naturalistic outcome measures
err2015-12-01
err0
errOAAI
errRiley Bove; Charles C. White; Gavin Giovannoni; Bonnie Glanz; Victor Golubchikov; Johnny Hujol; Charles Jennings; Dawn Langdon; Michelle Lee; Anna Legedza; James Paskavitz; Sashank Prasad; John Richert; Allison Robbins; Susan Roberts; Howard Weiner; Ravi Ramachandran; Martyn Botfield; Philip L. De Jager
errShare
errSave
Robust Semantic Communications With Masked VQ-VAE Enabled Codebook
err2023-12-01
err39
errOAAI
errHu, Qiyu; Zhang, Guangyi; Qin, Zhijin; Cai, Yunlong; Yu, Guanding; Li, Geoffrey Ye
errShare
errSave
Toward Semantic Communications: Deep Learning-Based Image Semantic Coding
err2023-01-01
err81
PREAI
errHuang, Danlan; Gao, Feifei; Tao, Xiaoming; Du, Qiyuan; Lu, Jianhua
errShare
errSave
Task-Oriented Multi-User Semantic Communications
err2022-09-01
err132
errOAAI
errXie, Huiqiang; Qin, Zhijin; Tao, Xiaoming; Letaief, Khaled B.
errShare
errSave
Deep Learning-Constructed Joint Transmission-Recognition for Internet of Things
err2019-01-01
err73
errOAAI
errLee, Chia-Han; Lin, Jia-Wei; Chen, Po-Hao; Chang, Yu-Chieh
errShare
errSave
errShare
errSave
Semantic Communications With Artificial Intelligence Tasks: Reducing Bandwidth Requirements and Improving Artificial Intelligence Task Performance
err2023-09-01
err30
PREAI
errYANG, Y. A. N. G.; GUO, C. A. I. L. I.; LIU, F. A. N. G. F. A. N. G.; SUN, L. U. N. A. N.; LIU, C. H. U. A. N. H. O. N. G.; SUN, Q. I. Z. H. E. N. G.
errShare
errSave
researcher View more