arrow
Return

Spatio-Temporal Correlation Guided Geometric Partitioning for Versatile Video Coding

delete2022-01-01
delete7
PRE
AI
X
Xuewei Meng
C
Chuanmin Jia *
X
Xinfeng Zhang
王苫社 cover
王苫社 (Shanshe Wang)
马思伟 (Siwei Ma)
DOI:10.1109/TIP.2021.3126420delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Geometric partitioning has attracted increasing attention by its remarkable motion field description capability in the hybrid video coding framework. However, the existing geometric partitioning (GEO) scheme in Versatile Video Coding (VVC) causes a non-negligible burden for signaling the side information. Consequently, the coding efficiency is limited. In view of this, we propose a spatio-temporal correlation guided geometric partitioning (STGEO) scheme to efficiently describe the object information in the motion field of video coding. The proposed method can economize the bits consumed for side information signaling, including the partitioning mode and motion information. We firstly analyze the characteristics of partitioning mode decision and motion vector selection in a statistically-sound way. Based on the observed spatio-temporal correlation, we design a mode prediction and coding method to reduce the overhead for representing the above mentioned side information. The main idea is to predict the STGEO modes and motion candidates that have higher selection possibilities, which can guide the entropy coding, i.e., representing the predicted high-probability modes and motion candidates with fewer bits. In particular, the high-probability STGEO modes are predicted based on the edge information and history modes of adjacent STGEO-coded blocks. The corresponding motion information is represented by the index in a merge candidate list, which is adaptively inferred based on the off-line trained merge candidate selection probability. Simulation results show that the proposed approach achieves 0.95% and 1.98% bit-rate savings on average compared to VTM-8.0 without GEO for Random Access and Low-Delay B configurations, respectively.
Keywords:
Video coding
Image coding
Correlation
Copper
Encoding
Standards
Motion compensation
Mode coding
mode prediction
geometric partitioning
inter prediction
versatile video coding

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

P
peking university
Scholars:
11.7W
Papers: 8.7W
Citations: 146
C
chinese academy of sciences
Scholars:
56.1W
Papers: 44.8W
Citations: 704