arrow
Return

Spherical Distortion Temporal Propagation and Spatial Mapping Model for Efficient Panoramic Video Coding

delete2024-06-01
delete0
PRE
AI
X
Xu Yang
M
Minfeng Huang
郭宏伟 cover
郭宏伟 (Hongwei Guo)
S
Shengxi Li
L
Lei Luo *
C
Ce Zhu
DOI:10.1109/TBC.2024.3358749delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Panoramic video undergoes projection onto a two-dimensional plane for compression and subsequent back-projection onto a sphere for display. This process introduces inconsistency between compression distortion and perceived spherical distortion, which causes a serious loss in coding efficiency. Meanwhile, the existing independent rate-distortion optimization (RDO) model for spherical distortion solely accounts for the current coding frame and neglects its influence on subsequent frames, which leads to sub-optimal coding performance. To this end, we propose a spherical distortion temporal propagation and spatial mapping model for efficient panoramic video coding. First, a zero-delay spherical distortion backward propagation chain is established in the temporal domain, and distortion impact factors are computed. Then, an accurate spatial mapping relationship between spherical distortion and coding distortion is constructed, along with the calculation of spatial mapping weights. Finally, these components are integrated into spherical RDO. The experimental results demonstrated the effectiveness of the proposed algorithm. Compared to the versatile video coding test model (VTM-14.0) with a 360Lib extension under low-delay P frame and B frame configurations, the proposed algorithm achieves bitrate savings of 9.4% (up to 19.4%) and 8.5% (up to 19.0%) by using WSPSNR as the distortion evaluation index, respectively. Additionally, the coding time was reduced by 14.53% and 15.65%, respectively.
Keywords:
Equirectangular projection
panoramic video coding
rate-distortion optimization
temporal dependency
spherical distortion
versatile video coding

Journal

IEEE Transactions on Broadcasting cover
IEEE Transactions on Broadcasting
IF:
4.8
Papers:
2.1K
Citations:
3.0K

Organization

C
chongqing university of posts & telecommunications
Scholars:
6.7K
Papers: 5.3K
Citations: 5
H
Honghe University
Scholars:
441
Papers: 364
Citations: 254