arrow
Return

Attention-Based Inter-Prediction for Versatile Video Coding

delete2023-01-01
delete3
delete
OA
AI
Q
Quang Nhat Tran *
S
Shih‐Hsuan Yang
DOI:10.1109/ACCESS.2023.3303510delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Versatile Video Coding (VVC) is the latest video coding standard, which provides significant coding efficiency to its successors based on new coding tools and flexibility. In this paper, we propose a generative adversarial network-based inter-picture prediction approach for VVC. The proposed method involves two major parts, deep attention map estimation and deep frame interpolation. Adjacent VVC-coded frames in every other frame are taken as the reference data for the proposed inter-picture prediction. The deep attention map classifies pixels into high-interest and low-interest. The low-interest pixels are replaced by the generated data from frame interpolation without extra coded bits, while the other pixels are encoded using the conventional VVC coding tools. The generation of the attention map and interpolated frame can be incorporated into the VVC encoding algorithm under a unified framework. Experimental results show that the proposed method improves the coding efficiency of VVC with a moderate increase (26.7%) in runtime. A BD-rate savings of 1.91% on average was achieved compared to the VVC reference software in the Random-Access configuration. A significant reduction in bitrate was observed for chroma components (U and V).
Keywords:
Attention map
deep learning
deep video coding tool
generative adversarial networks (GANs)
inter coding
video coding
Versatile Video Coding (VVC)

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

N
National Taipei University of Technology
Scholars:
7.1K
Papers: 7.3K
Citations: 6.8K
Cited Papers

Cited Papers

Angle-dispersive powder-diffraction techniques for crystal structure refinement at high pressure
err1992-01-01
err0
PREAI
errR. J. Nelmes; P. D. Hatton; M. I. McMahon; R. O. Piltz; J. Crain; R. J. Cernik; G. Bushnell-Wye
errShare
errSave
Magnetic properties of the Suzuki phase formed in NaCl:Mn2+
err1984-04-01
err0
PREAI
errM. Moreno; J. C. Gómez Sal; J. Aramburu; F. Rodríguez; J. L. Tholence; F. Jaque
errShare
errSave
An Improved Framework of Affine Motion Compensation in Video Coding
err2019-03-01
err58
PREAI
errZhang, Kai; Chen, Yi-Wen; Zhang, Li; Chien, Wei-Jung; Karczewicz, Marta
errShare
errSave
Insights into rRNA processing and modification mapping in Archaea using Nanopore-based RNA sequencing
err
IF0
err2021-06-14
err0
errOAAI
errFelix Grünberger; Michael Jüttner; Robert Knüppel; Sébastien Ferreira-Cerca; Dina Grohmann
errShare
errSave
errShare
errSave
researcher View more