arrow
Return

An Efficient and Flexible Complexity Control Method for Versatile Video Coding

delete2024-01-01
delete1
PRE
AI
Y
Yan Zhao *
C
Chen Zhu
J
Jun Xu
鲁国 (Guo Lu)
李松 (Li Song)
马思伟 (Siwei Ma)
DOI:10.1109/TBC.2024.3475811delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recently, numerous complexity control approaches have been proposed to achieve the target encoding complexity. However, only few of them were developed for VVC encoders. This paper fills this gap by proposing an efficient and flexible complexity control approach for VVC. The support for both Acceleration Ratio Control (ARC) and Encoding Time Control (ETC) makes our method highly versatile for various applications. At first, we introduce a sequence-level complexity estimation model to merge the ARC and ETC tasks. Then, four key modules are involved for complexity control: complexity allocation, complexity estimation, encoding configuration decision, and feedback. Specifically, we hierarchically allocate the complexity budget to three coding levels: GOP, frame, and Basic Unit (BU). Each BU's allocation weight is decided by its SSIM distortion, whereby the perceptual quality can be ensured. The multi-complexity configurations are established by altering the partition depth and number of reference frames. Via tuning each BU's configuration according to its target acceleration ratio and adaptively updating the control strategies based on the feedback, our scheme can precisely realize any achievable acceleration targets within one-pass encoding. Moreover, each BU's un-accelerated reference encoding time, which is used to calculate its target acceleration ratio, is estimated by SVR models. Experiments prove that for both the ARC and ETC tasks, our scheme can precisely achieve a wide range of complexity targets (30% similar to 100%) with negligible RD loss in PSNR and SSIM, outperforming other state-of-the-art methods.
Keywords:
Complexity theory
Encoding
Estimation
Resource management
Visualization
Standards
Partitioning algorithms
Distortion
Copper
Video recording
Versatile video coding (VVC)
complexity control
complexity estimation
block partition
motion estimation

Journal

IEEE Transactions on Broadcasting cover
IEEE Transactions on Broadcasting
IF:
4.8
Papers:
2.1K
Citations:
3.0K

Organization

S
shanghai jiao tong university
Scholars:
15.5W
Papers: 11.6W
Citations: 159