Adaptive Prediction Structure for Learned Video Compression

doi:10.1145/3703914

Adaptive Prediction Structure for Learned Video Compression

2024-12-30

0

OA

AI

DOI：10.1145/3703914

Original request for help

Save

Abstract

En 中文

Learned video compression has developed rapidly and shown competitive rate-distortion performance compared with the latest traditional video coding standard H.266 (VVC). However, existing works were restricted to fixed prediction direction and GoP size. The inflexibility on prediction structure hinders learned video compression towards optimal compression efficiency in diverse motion scenarios. In this article, we propose to advance learned video compression with adaptive prediction structure decision. Specifically, we propose a unified compression framework that supports both forward prediction and bi-directional prediction. The framework can flexibly switch to different prediction direction to achieve better prediction performance. Meanwhile, we propose a low-complexity prediction structure decision algorithm, where prediction direction and GoP size are adaptively determined based on motion complexity to achieve optimal compression efficiency. Experimental results demonstrate that the proposed unified framework with adaptive decision algorithm improves compression efficiency of pure forward prediction-based or bi-directional prediction-based framework with neglectable (0.9%) encoding time increment. Meanwhile, it achieves comparable compression performance with VVC and recent learned video coding methods.

Keywords:

Learned video compression

joint forward and bi-directional prediction

adaptive prediction structure decision

Adaptive Prediction Structure for Learned Video Compression

Abstract

Journal

Organization