.png){kind=icon}
返回
Variable-Rate Deep Image Compression With Vision Transformers
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2022.3173256.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Recently, vision transformers have been applied in many computer vision problems due to its long-range learning ability. However, it has not been throughly explored in image compression. We propose a patch-based learned image compression network by incorporating vision transformers. The input image is divided into patches before feeding to the encoder and the patches are reconstructed from the decoder to form a complete image. Different kinds of transformer blocks (TransBlocks) are applied to meet the various requirements in the subnetworks. We also propose a transformer-based context model (TransContext) to facilitate the coding based on previously decoded symbols. Since the computational complexity of the attention mechanism in transformers is a quadratic function of the sequence length, we partition the feature tensor into different segments and conduct the transformer in each segment to save computational cost. To alleviate the compression artifacts, we use overlapping patches and apply an existing deblocking network to further remove the artifacts. At last, the residual coding scheme is adopted to get the compression performance for variable bit rates. We show that our patch-based learned image compression with transformers obtain 0.75dB improvement in PSNR at 0.15bpp than the prior variable-rate compression work on the Kodak dataset. When using the residual coding strategy, our framework keeps good performance in PSNR and is comparable to BPG420. For MS-SSIM, we get higher results than BPG444 across a range of bit rates (0.021 at 0.21bpp) and other variable-rate learned image compression models at low bit rates.
Keyword:
Image coding
Transformers
Bit rate
Decoding
Context modeling
Computational modeling
Image reconstruction
Learned image compression
transformer
variable-rate
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Types of Parent Verbal Responsiveness That Predict Language in Young Children With Autism Spectrum Disorder预测自闭症谱系障碍幼儿语言的父母言语反应类型
OAAI
OAAI分享收藏Human action recognition using attention based LSTM network with dilated CNN features基于扩展CNN特征的基于注意力的LSTM网络的人体动作识别
PREAI
分享收藏VARIATION WITH DEPTH IN SHALLOW AND DEEP WATER MARINE SEDIMENTS OF POROSITY, DENSITY AND THE VELOCITIES OF COMPRESSIONAL AND SHEAR WAVES.png)
GEOPHYSICS
GEOPHYSICSIF0
PREAI
分享收藏
查看更多内容