arrow
Return

A convolutional neural network-based rate control algorithm for VVC intra coding

delete2024-04-01
delete3
PRE
AI
J
Jiafeng Wang
X
Xiaoli Zhao
Y
Yuhuai Zhang
DOI:10.1016/j.displa.2024.102652delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The Versatile Video Coding (VVC) has shown significant improvements in Rate-Distortion (R-D) performance compared to its predecessor, High Efficiency Video Coding (HEVC). However, it still encounters several challenges. One of these challenges is the efficient allocation of bits among all Coding Tree Units (CTUs). Additionally, there is a lack of prior information for intra-frame coding, particularly for the first frame. After CTU-level bit allocation, only fixed parameters can be used to determine the lambda for CTUs, which does not result in optimal ratedistortion performance. To tackle above challenges, we propose a rate control solution based on Convolutional Neural Network (CNN). This approach utilizes CNN to predict the key parameters alpha and beta in the R-D model, addressing the problem of lacking prior information in intra-frame coding. Subsequently, the predicted alpha and beta values are used to adaptively allocate bits for each CTU. Our proposed algorithm is implemented in VTM-16.0 under Common Test Conditions (CTC). Experimental results show that, compared to the default rate control algorithm in VTM-16.0, our proposed algorithm enhances R-D performance by 0.96% while maintaining rate control accuracy.
Keywords:
H.266/VVC
Intra coding
Rate control
Convolutional Neural Network (CNN)

Journal

Displays cover
Displays
IF:
3.4
Papers:
2.2K
Citations:
3.2K

Organization

S
Shanghai University of Engineering Science
Scholars:
7.8K
Papers: 4.8K
Citations: 6.0K
P
peking university
Scholars:
11.8W
Papers: 8.7W
Citations: 146