arrow
返回

Multi-scale spatial-spectral attention network for multispectral image compression based on variational autoencoder

delete2022-09-01
delete20
PRE
AI
F
Fanqiang Kong
T
Tongbo Cao *
李云松 封面图
李云松 (Yunsong Li)
D
Dan Li
K
Kedi Hu
DOI:10.1016/j.sigpro.2022.108589delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Based upon the fact that multispectral image compression needs to remove both spatial and spectral redundancy, recent learnt models via end-to-end manners have shown promising performance. However, most of them ignore the characteristics of multispectral image, i.e., the non-stationarity of spectral correlation and the scale-diversity of spatial features. Meanwhile, they directly utilize fully factorized entropy model, rendering compression performance suboptimal. This paper proposes a Multi-Scale SpatialSpectral Attention Network (MSSSA-Net) based on variational autoencoder (VAE). Our MSSSA-Net (1) incorporates a simple neuroscience-based non-local attention module into attention mechanism to capture the tiny features in adjacent pixels and large-scale features in spatial domain simultaneously, (2) proposes a multi-scale spectral attention block to extract non-stationary correlation of adjacent spectra at different scales. We demonstrate that our MSSSA-Net offers the state-of-the-art performance in comparison with classical algorithms, including JPEG20 0 0 and 3D-SPIHT, and recent learnt image compression models, on 7-band and 8-band datasets from Landsat-8 and WorldView-3 satellites, when measured by PSNR, MSSSIM and Mean Spectral Angle. Extensive ablation experiments have verified the effectiveness of each component, and have demonstrated that, for multispectral image compression, Scale-only Hyperprior can make a better trade-off between compression performance and complexity compared with Mean & Scale Hyperprior and Joint Autoregressive model.
Keyword:
Hierarchical prior model
Learnt multispectral image compression
Spatial-spectral attention
Variational autoencoder

期刊

Signal Processing 封面图
Signal Processing
IF:
3.6
论文数:
10.0K
被引数:
1.7W

机构

X
Xidian University
学者数:
2.4W
论文数: 1.9W
被引数: 9.7K
引用论文

引用论文

Versican is upregulated in circulating monocytes in patients with systemic sclerosis and amplifies a CCL2-mediated pathogenic loop
err2013-07-11
err0
errOAAI
errAyako Masuda; Hidekata Yasuoka; Takashi Satoh; Yuka Okazaki; Yukie Yamaguchi; Masataka Kuwana
err分享
err收藏
Graph Convolutional Networks for Hyperspectral Image Classification用于高光谱图像分类的图卷积网络
err2021-07-01
err1.3K
errOAAI
errHong, Danfeng; Gao, Lianru; Yao, Jing; Zhang, Bing; Plaza, Antonio; Chanussot, Jocelyn
err分享
err收藏
Neurosyphilis in patients with HIV
err2018-02-24
err0
errOAAI
errEmily Hobbs; Jaime H Vera; Michael Marks; Andrew William Barritt; Basil H Ridha; David Lawrence
err分享
err收藏
err分享
err收藏
Untersuchungen zur Struktur der Ferredoxine
err1969-03-01
err0
errOAAI
errE. Bayer; H. Eckstein; H. Hagenmaier; D. Josef; J. Koch; P. Krauss; A. Roder; P. Schretzmann
err分享
err收藏
学者 查看更多内容