arrow
返回

Learning Context-Based Nonlocal Entropy Modeling for Image Compression

delete2023-03-01
delete14
delete
OA
AI
李
李穆 (Mu Li)
K
Kai Zhang
李
李锦兴 (Jinxing Li) *
左
左旺孟 (Wangmeng Zuo)
R
Radu Timofte
章典 封面图
章典 (David Zhang)
DOI:10.1109/TNNLS.2021.3104974delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The entropy of the codes usually serves as the rate loss in the recent learned lossy image compression methods. Precise estimation of the probabilistic distribution of the codes plays a vital role in reducing the entropy and boosting the joint rate-distortion performance. However, existing deep learning based entropy models generally assume the latent codes are statistically independent or depend on some side information or local context, which fails to take the global similarity within the context into account and thus hinders the accurate entropy estimation. To address this issue, we propose a special nonlocal operation for context modeling by employing the global similarity within the context. Specifically, due to the constraint of context, nonlocal operation is incalculable in context modeling. We exploit the relationship between the code maps produced by deep neural networks and introduce the proxy similarity functions as a workaround. Then, we combine the local and the global context via a nonlocal attention block and employ it in masked convolutional networks for entropy modeling. Taking the consideration that the width of the transforms is essential in training low distortion models, we finally produce a U-net block in the transforms to increase the width with manageable memory consumption and time complexity. Experiments on Kodak and Tecnick datasets demonstrate the priority of the proposed context-based nonlocal attention block in entropy modeling and the U-net block in low distortion situations. On the whole, our model performs favorably against the existing image compression standards and recent deep image compression models.
Keyword:
Image coding
Entropy
Context modeling
Transforms
Convolutional codes
Estimation
Computational modeling
Entropy modeling
learned image compression
nonlocal
U-net block

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

H
harbin institute of technology
学者数:
8.0W
论文数: 6.6W
被引数: 66
U
university of science & technology of china, cas
学者数:
3.2W
论文数: 2.7W
被引数: 74
T
The Chinese University of Hong Kong, Shenzhen
学者数:
4.3K
论文数: 4.0K
被引数: 7
S
swiss federal institutes of technology domain
学者数:
9.0W
论文数: 8.0W
被引数: 163
学者 查看更多机构
引用论文

引用论文

Thermodynamics study on the generation of electricity via CO2-mineralization cell
err2015-08-23
err0
errOAAI
errHeping Xie; Wen Jiang; Yufei Wang; Tao Liu; Ruilin Wang; Bin Liang; Yang He; Jinlong Wang; Liang Tang; Jinwei Chen
err分享
err收藏
Deep FisherNet for Image Classification
err2019-07-01
err42
PREAI
errTang, Peng; Wang, Xinggang; Shi, Baoguang; Bai, Xiang; Liu, Wenyu; Tu, Zhuowen
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容