arrow
Return

Image compression based on octave convolution and semantic segmentation

delete2021-09-01
delete8
PRE
AI
Z
Zhiyuan Liu
L
Lili Meng *
Y
Yanyan Tan
J
Jia Zhang
H
Huaxiang Zhang
DOI:10.1016/j.knosys.2021.107254delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Lossy image compression based on deep learning usually contains stacking convolutional layers, pooling layers, and nonlinear functions. However, the feature map is obtained by the convolutional layer, which has a lot of redundancy, so we use octave convolution instead of vanilla convolution to improve compression efficiency. The feature map can be divided into high-frequency and lowfrequency information. We use octave convolution to design an automatic codec to decompose the feature map into high-frequency and low-frequency information, which effectively improves the quality of the generated image. First, the semantic segmentation map of the input image is obtained by pre-training SegNet. The ComNet uses the original image and the semantic segmentation map to generate a low-dimensional representation, and the GenNet network utilizes the low-dimensional representation and the semantic segmentation map to estimate images. Then, the residuals between the reconstructed image and the original image are encoded. Finally, the reconstructed image and the decoded residual image are used to obtain the final high-quality reconstruction. Experimental results show that our method outperforms the existing image coding standards in terms of PSNR and MS-SSIM at different bit rates, and the reconstruction of images with complex textures and semantics has more obvious advantages. (C) 2021 Elsevier B.V. All rights reserved.
Keywords:
Image compression
Deep learning
Octave convolution
Semantic segmentation map

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

S
shandong normal university
Scholars:
1.0W
Papers: 8.2K
Citations: 3
Cited Papers

Cited Papers

A Pilot Study of the Efficacy of the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders in Treating Posttraumatic Psychopathology: A Randomized Controlled Trial
err2021-01-16
err0
errOAAI
errMeaghan L. O'Donnell; Winnie Lau; Katherine Chisholm; James Agathos; Jonathon Little; Sonia Terhaag; Rachel Brand; Andrea Putica; Alexander C. N. Holmes; Lynda Katona; Kim L. Felmingham; Kim Murray; Fardous Hosseiny; Matthew W. Gallagher
errShare
errSave
Methyl jasmonate-induced enhancement of expression activity of Am-FaPS-1, a putative farnesyl diphosphate synthase gene from Aquilaria microcarpa
err2010-08-05
err0
PREAI
errYoshihide Kenmotsu; Shinjiro Ogita; Yasuo Katoh; Yoshimi Yamamura; Yasumasa Takao; Yoshiaki Tatsuo; Hiroharu Fujino; Shigetoshi Kadota; Fumiya Kurosaki
errShare
errSave
A Review of Quality Assessment and Grading for Agarwood
err2017-01-01
err0
PREAI
errYang-yang Liu; Jian-he Wei; Zhi-hui Gao; Zheng Zhang; Jun-chen Lyu
errShare
errSave
errShare
errSave
Demonstration of secure slicing using ETSI MANO enhanced with Usage Control Capability
err2019-06-01
err0
PREAI
errA. La Marra; A. Lunardelli; F. Martinelli; P. Mori; A. Saracino; P. Castoldi; F. Marino; B. Martini
errShare
errSave
The JPEG 2000 still image compression standard
err2001-01-01
err1.2K
errOAAI
errSkodras, A; Christopoulos, C; Ebrahimi, T
errShare
errSave
researcher View more