arrow
Return

Learned Video Compression With Efficient Temporal Context Learning

delete2023-01-01
delete6
PRE
AI
D
Dengchao Jin
雷建军 (Jianjun Lei) *
彭勃 cover
彭勃 (Peng, Bo)
潘兆庆 cover
潘兆庆 (Zhaoqing Pan)
李莉 (Li Li)
N
Nam Ling
DOI:10.1109/TIP.2023.3276333delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In contrast to image compression, the key of video compression is to efficiently exploit the temporal context for reducing the inter-frame redundancy. Existing learned video compression methods generally rely on utilizing short-term temporal correlations or image-oriented codecs, which prevents further improvement of the coding performance. This paper proposed a novel temporal context-based video compression network (TCVC-Net) for improving the performance of learned video compression. Specifically, a global temporal reference aggregation (GTRA) module is proposed to obtain an accurate temporal reference for motion-compensated prediction by aggregating long-term temporal context. Furthermore, in order to efficiently compress the motion vector and residue, a temporal conditional codec (TCC) is proposed to preserve structural and detailed information by exploiting the multi-frequency components in temporal context. Experimental results show that the proposed TCVC-Net outperforms public state-of-the-art methods in terms of both PSNR and MS-SSIM metrics.
Keywords:
Image coding
Video compression
Transforms
Codecs
Quantization (signal)
Video coding
Motion compensation
Learned video compression
inter-frame prediction
long-term correspondence
temporal context learning
TCVC-Net

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

T
tianjin university
Scholars:
8.0W
Papers: 5.8W
Citations: 88
U
university of science & technology of china, cas
Scholars:
3.2W
Papers: 2.7W
Citations: 74
C
chinese academy of sciences
Scholars:
56.7W
Papers: 44.9W
Citations: 704
researcher View more organizations
Cited Papers

Cited Papers

Low-Area Active-Feedback Low-Noise Amplifier Design in Scaled Digital CMOS
err2008-11-01
err0
PREAI
errJonathan Borremans; Piet Wambacq; Charlotte Soens; Yves Rolain; Maarten Kuijk
errShare
errSave
Structural incorporation of MgCl2into ice VII at room temperature
err2017-04-10
err0
PREAI
errMao Watanabe; Kazuki Komatsu; Fumiya Noritake; Hiroyuki Kagi
errShare
errSave
Generating high quality ultrarelativistic electron beams using an evolving electron beam driver
err2020-02-28
err0
errOAAI
errT. N. Dalichaouch; X. L. Xu; F. Li; A. Tableman; F. S. Tsung; W. An; W. B. Mori
errShare
errSave
1013-2007
err
IF0
err2007-01-01
err0
PREAI
err
errShare
errSave
A novel biologic platform elicits profound T cell costimulatory activity and antitumor immunity in mice
err2018-01-11
err0
errOAAI
errJoseph M. Ryan; Payal Mittal; Antoine Menoret; Julia Svedova; Jeffrey S. Wasser; Adam J. Adler; Anthony T. Vella
errShare
errSave
researcher View more