arrow
Return

Deep Network for Image Compressed Sensing Coding Using Local Structural Sampling

delete2024-05-16
delete1
delete
OA
AI
W
Wenxue Cui
X
Xingtao Wang
范晓鹏 (Xiaopeng Fan)
刘绍辉 (Shaohui Liu)
X
Xinwei Gao
D
Debin Zhao *
DOI:10.1145/3649441delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Existing image compressed sensing (CS) coding frameworks usually solve an inverse problem based on measurement coding and optimization-based image reconstruction, which still exist the following two challenges: (1) the widely used random sampling matrix, such as the Gaussian Random Matrix (GRM), usually leads to low measurement coding efficiency, and (2) the optimization-based reconstruction methods generally maintain a much higher computational complexity. In this article, we propose a new convolutional neural network based image CS coding framework using local structural sampling (dubbed CSCNet) that includes three functional modules: local structural sampling, measurement coding, and Laplacian pyramid reconstruction. In the proposed framework, instead of GRM, a new local structural sampling matrix is first developed, which is able to enhance the correlation between the measurements through a local perceptual sampling strategy. Besides, the designed local structural sampling matrix can be jointly optimized with the other functional modules during the training process. After sampling, the measurements with high correlations are produced, which are then coded into final bitstreams by the third-party image codec. Last, a Laplacian pyramid reconstruction network is proposed to efficiently recover the target image from the measurement domain to the image domain. Extensive experimental results demonstrate that the proposed scheme outperforms the existing state-of-the-art CS coding methods while maintaining fast computational speed.
Keywords:
Compressed sensing (CS)
compressed sensing coding
local structural sampling
convolutional neural network (CNN)
third-party image codec

Journal

ACM Transactions on Multimedia Computing Communications and Applications cover
ACM Transactions on Multimedia Computing Communications and Applications
IF:
6
Papers:
2.0K
Citations:
5.4K

Organization

H
harbin institute of technology
Scholars:
8.0W
Papers: 6.6W
Citations: 66
T
Tencent
Scholars:
1.1K
Papers: 891
Citations: 5