返回
Image compression based on octave convolution and semantic segmentation
DOI:10.1016/j.knosys.2021.107254.png)
摘要
En 中文
Lossy image compression based on deep learning usually contains stacking convolutional layers, pooling layers, and nonlinear functions. However, the feature map is obtained by the convolutional layer, which has a lot of redundancy, so we use octave convolution instead of vanilla convolution to improve compression efficiency. The feature map can be divided into high-frequency and lowfrequency information. We use octave convolution to design an automatic codec to decompose the feature map into high-frequency and low-frequency information, which effectively improves the quality of the generated image. First, the semantic segmentation map of the input image is obtained by pre-training SegNet. The ComNet uses the original image and the semantic segmentation map to generate a low-dimensional representation, and the GenNet network utilizes the low-dimensional representation and the semantic segmentation map to estimate images. Then, the residuals between the reconstructed image and the original image are encoded. Finally, the reconstructed image and the decoded residual image are used to obtain the final high-quality reconstruction. Experimental results show that our method outperforms the existing image coding standards in terms of PSNR and MS-SSIM at different bit rates, and the reconstruction of images with complex textures and semantics has more obvious advantages. (C) 2021 Elsevier B.V. All rights reserved.
Keyword:
Image compression
Deep learning
Octave convolution
Semantic segmentation map
期刊
K
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
The Role of Curvature in Modifying Frontal Instabilities. Part II: Application of the Criterion to Curved Density Fronts at Low Richardson Numbers曲率在改变额叶不稳定性中的作用。第二部分: 该准则在低理查森数下弯曲密度前沿的应用

