arrow
Return

Object-Attribute-Relation Representation-Based Video Semantic Communication

delete2025-07-01
delete0
PRE
AI
Q
Qiyuan Du
Y
Yiping Duan
Q
Qianqian Yang
X
Xiaoming Tao
M
Mérouane Debbah
DOI:10.1109/JSAC.2025.3559115delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
With the rapid growth of multimedia data volume, there is an increasing need for efficient video transmission in applications such as virtual reality and future video streaming services. Semantic communication is emerging as a vital technique for ensuring efficient and reliable transmission in low-bandwidth, high-noise settings. However, most current approaches focus on joint source-channel coding (JSCC) that depends on end-to-end training. These methods often lack an interpretable semantic representation and struggle with adaptability to various downstream tasks. In this paper, we introduce the use of object-attribute-relation (OAR) as a semantic framework for videos to facilitate low bit-rate coding and enhance the JSCC process for more effective video transmission. We utilize OAR sequences for both low bit-rate representation and generative video reconstruction. Additionally, we incorporate OAR into the image JSCC model to prioritize communication resources for areas more critical to downstream tasks. Our experiments on traffic surveillance video datasets assess the effectiveness of our approach in terms of video transmission performance. The empirical findings demonstrate that our OAR-based video coding method not only outperforms H.265 coding at lower bit-rates but also synergizes with JSCC to deliver robust and efficient video transmission.
Keywords:
Video coding
object-attribute-relation
wireless transmission
joint source-channel coding
semantic communication

Journal

IEEE Journal on Selected Areas in Communications cover
IEEE Journal on Selected Areas in Communications
IF:
17.2
Papers:
6.4K
Citations:
3.1W

Organization

K
Khalifa University
Scholars:
840
Papers: 445
Citations: 7
T
tsinghua university
Scholars:
11.9W
Papers: 10.0W
Citations: 137
Z
zhejiang university
Scholars:
17.7W
Papers: 12.1W
Citations: 152
researcher View more organizations
Cited Papers

Cited Papers

Adaptive Bitrate Video Semantic Communication over Wireless Networks
err
IF0
err2023-11-02
err0
PREAI
errWentao Gong; Haonan Tong; Sihua Wang; Zhaohui Yang; Xinxin He; Changchuan Yin
errShare
errSave
Learning Canonical Representations for Scene Graph to Image Generation
err2020-11-13
err0
PREAI
errRoei Herzig; Amir Bar; Huijuan Xu; Gal Chechik; Trevor Darrell; Amir Globerson
errShare
errSave
VR plus HD: Video Semantic Reconstruction From Spatio-Temporal Scene Graphs
err2023-09-01
err0
PREAI
errLi, Chenxing; Duan, Yiping; Du, Qiyuan; Sun, Shiqi; Deng, Xin; Tao, Xiaoming
errShare
errSave
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations
err2017-02-06
err3.1K
errOAAI
errKrishna, Ranjay; Zhu, Yuke; Groth, Oliver; Johnson, Justin; Hata, Kenji; Kravitz, Joshua; Chen, Stephanie; Kalantidis, Yannis; Li, Li-Jia; Shamma, David A.; Bernstein, Michael S.; Li Fei-Fei
errShare
errSave
errShare
errSave
researcher View more