.png){kind=icon}
返回
CS2DIPs: Unsupervised HSI Super-Resolution Using Coupled Spatial and Spectral DIPs
.png){kind=icon}
PRE
AI
DOI：10.1109/TIP.2024.3390582.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In recent years, fusing high spatial resolution multispectral images (HR-MSIs) and low spatial resolution hyperspectral images (LR-HSIs) has become a widely used approach for hyperspectral image super-resolution (HSI-SR). Various unsupervised HSI-SR methods based on deep image prior (DIP) have gained wide popularity thanks to no pre-training requirement. However, DIP-based methods often demonstrate mediocre performance in extracting latent information from the data. To resolve this performance deficiency, we propose a coupled spatial and spectral deep image priors (CS2DIPs) method for the fusion of an HR-MSI and an LR-HSI into an HR-HSI. Specifically, we integrate the nonnegative matrix-vector tensor factorization (NMVTF) into the DIP framework to jointly learn the abundance tensor and spectral feature matrix. The two coupled DIPs are designed to capture essential spatial and spectral features in parallel from the observed HR-MSI and LR-HSI, respectively, which are then used to guide the generation of the abundance tensor and spectral signature matrix for the fusion of the HSI-SR by mode-3 tensor product, meanwhile taking some inherent physical constraints into account. Free from any training data, the proposed CS2DIPs can effectively capture rich spatial and spectral information. As a result, it exhibits much superior performance and convergence speed over most existing DIP-based methods. Extensive experiments are provided to demonstrate its state-of-the-art overall performance including comparison with benchmark peer methods.
Keyword:
Hyperspectral image
multispectral image
deep image prior
super-resolution
nonnegative matrix-vector tensor factorization
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
Ultraviolet-Diode Pump Solid State Laser Removal of Titanium Aluminium Nitride Coating from Tungsten Carbide Substrate紫外二极管泵浦固体激光去除碳化钨基体上的氮化钛铝涂层
PREAI
分享收藏
Learning a 3D-CNN and Transformer prior for hyperspectral image-resolution高光谱图像分辨率的3D-CNN和变压器先验学习.png)
INFORMATION FUSION
OAAI
INFORMATION FUSIONIF15.5
OAAI分享收藏Spatial-Spectral Structured Sparse Low-Rank Representation for Hyperspectral Image Super-Resolution
PREAI
分享收藏
查看更多内容