arrow
Return

Semantic Importance-Aware Communications Using Pre-Trained Language Models

delete2023-09-01
delete19
delete
OA
AI
S
Shuaishuai Guo *
Y
Yanhu Wang
S
Shujing Li
N
Nasir Saeed
DOI:10.1109/LCOMM.2023.3293805delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This letter proposes a semantic importance-aware communication (SIAC) scheme using pre-trained language models (e.g., ChatGPT, BERT, etc.). Specifically, we propose a cross-layer design with a pre-trained language model embedded in/connected by the cross-layer manager. The pre-trained language model is utilized to quantify the semantic importance of data frames. Based on the quantified semantic importance, we investigate semantic importance-aware power allocation. Unlike existing deep joint source-channel coding (Deep-JSCC)-based semantic communication schemes, SIAC can be directly embedded into current communication systems by only introducing a cross-layer manager. Our experimental results show that the proposed SIAC scheme can achieve lower semantic loss than existing equal-priority communications.
Keywords:
Semantics
Chatbots
Bit error rate
Licenses
Cross layer design
Resource management
Communication systems
Semantic communications
pre-trained language model
power allocation
data importance

Journal

IEEE Communications Letters cover
IEEE Communications Letters
IF:
4.4
Papers:
1.2W
Citations:
2.2W

Organization

S
shandong university
Scholars:
9.3W
Papers: 6.4W
Citations: 94