arrow
返回

Model Inspired Autoencoder for Unsupervised Hyperspectral Image Super-Resolution

delete2022-01-01
delete64
delete
OA
AI
J
Jianjun Liu *
Z
Zebin Wu
肖
肖亮 (Liang Xiao)
X
Xiao‐Jun Wu
DOI:10.1109/TGRS.2022.3143156delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This article focuses on hyperspectral image (HSI) super-resolution that aims to fuse a low-spatial-resolution HSI and a high-spatial-resolution multispectral image to form a high-spatial-resolution HSI (HR-HSI). Existing deep learning-based approaches are mostly supervised that rely on a large number of labeled training samples, which is unrealistic. The commonly used model-based approaches are unsupervised and flexible but rely on handcrafted priors. Inspired by the specific properties of model, we make the first attempt to design a model-inspired deep network for HSI super-resolution in an unsupervised manner. This approach consists of an implicit autoencoder network built on the target HR-HSI that treats each pixel as an individual sample. The nonnegative matrix factorization (NMF) of the target HR-HSI is integrated into the autoencoder network, where the two NMF parts, spectral and spatial matrices, are treated as decoder parameters and hidden outputs, respectively. In the encoding stage, we present a pixelwise fusion model to estimate hidden outputs directly and then reformulate and unfold the model & x2019;s algorithm to form the encoder network. With the specific architecture, the proposed network is similar to a manifold prior-based model and can be trained patch by patch rather than the entire images. Moreover, we propose an additional unsupervised network to estimate the point spread function and spectral response function. Experimental results conducted on both synthetic and real datasets demonstrate the effectiveness of the proposed approach.
Keyword:
Superresolution
Spatial resolution
Hyperspectral imaging
Fuses
Decoding
Energy resolution
Tensors
Autoencoder
hyperspectral image (HSI)
nonnegative matrix factorization (NMF)
super-resolution
unfolding

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.1W
被引数:
10.7W

机构

J
Jiangnan University
学者数:
3.9W
论文数: 2.7W
被引数: 4.7W
引用论文

引用论文

Remote Sensing Image Super-Resolution Using Novel Dense-Sampling Networks
err2021-02-01
err110
PREAI
errDong, Xiaoyu; Sun, Xu; Jia, Xiuping; Xi, Zhihong; Gao, Lianru; Zhang, Bing
err分享
err收藏
Hyperspectral Image Super-Resolution by Band Attention Through Adversarial Learning
err2020-06-01
err87
PREAI
errLi, Jiaojiao; Cui, Ruxing; Li, Bo; Song, Rui; Li, Yunsong; Dai, Yuchao; Du, Qian
err分享
err收藏
FusionNet: An Unsupervised Convolutional Variational Network for Hyperspectral and Multispectral Image Fusion
err2020-01-01
err81
PREAI
errWang, Zhengjue; Chen, Bo; Lu, Ruiying; Zhang, Hao; Liu, Hongwei; Varshney, Pramod K.
err分享
err收藏
Spatial-Spectral Structured Sparse Low-Rank Representation for Hyperspectral Image Super-Resolution
err2021-01-01
err137
PREAI
errXue, Jize; Zhao, Yong-Qiang; Bu, Yuanyang; Liao, Wenzhi; Chan, Jonathan Cheung-Wai; Philips, Wilfried
err分享
err收藏
学者 查看更多内容