arrow
返回

Enhanced Context Mining and Filtering for Learned Video Compression

delete2024-01-01
delete1
PRE
AI
H
Haifeng Guo
S
Sam Kwong *
D
Dongjie Ye
S
Shiqi Wang
DOI:10.1109/TMM.2023.3316429delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The Deep Contextual Video Compression framework (DCVC) utilizes a conditional coding paradigm, where the context is extracted and employed as a condition for the contextual encoder-decoder and entropy model. In this paper, we propose enhanced context mining and filtering to improve the compression efficiency of DCVC. Firstly, considering the context of DCVC is generated without supervision and redundancy may exist among context channels, an enhanced context mining model is proposed to mitigate redundancy across context channels to obtain superior context features. Then, we introduce a transformer-based enhancement network as a filtering module to capture long-distance dependencies and further enhance compression efficiency. The transformer-based enhancement adopts a full-resolution pipeline and calculates self-attention across channel dimensions. By combining the local modeling ability of the enhanced context mining model and the non-local modeling ability of the transformer-based enhancement network, our model outperforms LDP configurations of Versatile Video Coding (VVC), achieving an average bit savings of 6.7% in terms of MS-SSIM.
Keyword:
Video compression
Context modeling
Transformers
Image coding
Entropy
Filtering
Codes
Learned video compression
end-to-end training approach
enhanced context mining
in loop filtering

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.6K
被引数:
2.4W

机构

C
City University of Hong Kong
学者数:
2.3W
论文数: 3.0W
被引数: 6.1W
L
Lingnan University
学者数:
1.0K
论文数: 1.4K
被引数: 202
引用论文

引用论文

err分享
err收藏
Advances in Video Compression System Using Deep Neural Network: A Review and Case Studies
err2021-09-01
err34
errOAAI
errDing, Dandan; Ma, Zhan; Chen, Di; Chen, Qingshuang; Liu, Zoe; Zhu, Fengqing
err分享
err收藏
Generating high quality ultrarelativistic electron beams using an evolving electron beam driver
err2020-02-28
err0
errOAAI
errT. N. Dalichaouch; X. L. Xu; F. Li; A. Tableman; F. S. Tsung; W. An; W. B. Mori
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容