arrow
Return

Object-attribute-relation model-based semantic coding for image transmission

delete2024-07-01
delete0
PRE
AI
Y
Yiping Duan *
X
Xiaoming Tao
胡舒展 cover
胡舒展 (Shuzhan Hu)
Q
Qianqian Yang
C
Chang Wen Chen
DOI:10.1016/j.jfranklin.2024.106942delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The development of digital, networked and intelligent communication technology has led to significant growth in data and services. Especially in the communication scenario of monitoring data, a variety of downstream tasks bring significant technical challenges for highperformance data transmission, information mining, and data distribution. The problem to be solved is the coding and low bit -rate transmission of large amounts of surveillance data. Concepts and methods that utilize semantic communication are needed. This paper proposes a communication architecture based on the object-attribute-relation (OAR) semantic knowledge base. The sender uses the model parameters and prior knowledge in the knowledge base to drive the OAR extraction model to encode the image. After semantic coding and channel coding, the signal is transmitted to the receiver through the physical channel. At the receiver, the signal is decoded into a semantic vector. The OAR global vector is generated by structured processing, which is used for downstream tasks such as image retrieval or image reconstruction. Experimental comparison and analysis illustrate the effectiveness and superiority of each part of the communication framework. This approach provides a new solution for improving data utilization and processing efficiency.
Keywords:
Semantic knowledge base
Object-attribute-relation (OAR)
Image retrieval
Semantic coding
Semantic communication

Journal

J
Journal of the Franklin Institute-Engineering and Applied Mathematics
IF:
3.7
Papers:
6.4K
Citations:
1.5W

Organization

H
hong kong polytechnic university
Scholars:
3.0W
Papers: 4.1W
Citations: 921
T
tsinghua university
Scholars:
11.9W
Papers: 10.0W
Citations: 137
Z
zhejiang university
Scholars:
17.7W
Papers: 12.1W
Citations: 152
researcher View more organizations
Cited Papers

Cited Papers

errShare
errSave
Is Mitochondrial Dysfunction a Common Root of Noncommunicable Chronic Diseases?
err2020-03-16
err0
errOAAI
errAlexis Diaz-Vegas; Pablo Sanchez-Aguilera; James R Krycer; Pablo E Morales; Matías Monsalves-Alvarez; Mariana Cifuentes; Beverly A Rothermel; Sergio Lavandero
errShare
errSave
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations
err2017-02-06
err3.1K
errOAAI
errKrishna, Ranjay; Zhu, Yuke; Groth, Oliver; Johnson, Justin; Hata, Kenji; Kravitz, Joshua; Chen, Stephanie; Kalantidis, Yannis; Li, Li-Jia; Shamma, David A.; Bernstein, Michael S.; Li Fei-Fei
errShare
errSave
Bill morphology and biometrics of three sibling woodpecker species from sympatric populations
err2020-03-05
err0
PREAI
errŁukasz Myczko; Zuzana Mizerová; Anna Maria Kubicka; Tim H. Sparks; Martin Hromada
errShare
errSave
Materials Imaging and Dynamics (MID) instrument at the European X-ray Free-Electron Laser Facility
err2021-02-15
err0
errOAAI
errA. Madsen; J. Hallmann; G. Ansaldi; T. Roth; W. Lu; C. Kim; U. Boesenberg; A. Zozulya; J. Möller; R. Shayduk; M. Scholz; A. Bartmann; A. Schmidt; I. Lobato; K. Sukharnikov; M. Reiser; K. Kazarian; I. Petrov
errShare
errSave
researcher View more