返回
Multi-scale spatial-spectral attention network for multispectral image compression based on variational autoencoder
DOI:10.1016/j.sigpro.2022.108589.png)
摘要
En 中文
Based upon the fact that multispectral image compression needs to remove both spatial and spectral redundancy, recent learnt models via end-to-end manners have shown promising performance. However, most of them ignore the characteristics of multispectral image, i.e., the non-stationarity of spectral correlation and the scale-diversity of spatial features. Meanwhile, they directly utilize fully factorized entropy model, rendering compression performance suboptimal. This paper proposes a Multi-Scale SpatialSpectral Attention Network (MSSSA-Net) based on variational autoencoder (VAE). Our MSSSA-Net (1) incorporates a simple neuroscience-based non-local attention module into attention mechanism to capture the tiny features in adjacent pixels and large-scale features in spatial domain simultaneously, (2) proposes a multi-scale spectral attention block to extract non-stationary correlation of adjacent spectra at different scales. We demonstrate that our MSSSA-Net offers the state-of-the-art performance in comparison with classical algorithms, including JPEG20 0 0 and 3D-SPIHT, and recent learnt image compression models, on 7-band and 8-band datasets from Landsat-8 and WorldView-3 satellites, when measured by PSNR, MSSSIM and Mean Spectral Angle. Extensive ablation experiments have verified the effectiveness of each component, and have demonstrated that, for multispectral image compression, Scale-only Hyperprior can make a better trade-off between compression performance and complexity compared with Mean & Scale Hyperprior and Joint Autoregressive model.
Keyword:
Hierarchical prior model
Learnt multispectral image compression
Spatial-spectral attention
Variational autoencoder
期刊
IF:
3.6
论文数:
10.0K
被引数:
1.7W
机构
引用论文
Hyperspectral Image Denoising Employing a Spatial-Spectral Deep Residual Convolutional Neural Network基于空间光谱深度残差卷积神经网络的高光谱图像去噪
Image compression techniques: A survey in lossless and lossy algorithms图像压缩技术: 无损和有损算法综述
NEUROCOMPUTING
IF6.5
Effectiveness Of Mindfulness Based Stress Reduction On Depression In Elderly: A Systematic Review正念减压疗法对老年人抑郁的疗效:一项系统综述

