.png){kind=icon}
返回
Multi-Task Interaction Learning for Spatiospectral Image Super-Resolution
.png){kind=icon}
PRE
AI
DOI：10.1109/TIP.2022.3161834.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
High spatial resolution and high spectral resolution images (HR-HSIs) are widely applied in geosciences, medical diagnosis, and beyond. However, how to get images with both high spatial resolution and high spectral resolution is still a problem to be solved. In this paper, we present a deep spatial-spectral feature interaction network (SSFIN) for reconstructing an HR-HSI from a low-resolution multispectral image (LR-MSI), e.g., RGB image. In particular, we introduce two auxiliary tasks, i.e., spatial super-resolution (SR) and spectral SR to help the network recover the HR-HSI better. Since higher spatial resolution can provide more detailed information about image texture and structure, and richer spectrum can provide more attribute information, we propose a spatial-spectral feature interaction block (SSFIB) to make the spatial SR task and the spectral SR task benefit each other. Therefore, we can make full use of the rich spatial and spectral information extracted from the spatial SR task and spectral SR task, respectively. Moreover, we use a weight decay strategy (for the spatial and spectral SR tasks) to train the SSFIN, so that the model can gradually shift attention from the auxiliary tasks to the primary task. Both quantitative and visual results on three widely used HSI datasets demonstrate that the proposed method achieves a considerable gain compared to other state-of-the-art methods. Source code is available at https://github.com/junjun-jiang/SSFIN.
Keyword:
Task analysis
Superresolution
Spatial resolution
Hyperspectral imaging
Correlation
Image reconstruction
Representation learning
Super-resolution
hyperspectral image
auxiliary tasks
feature interaction
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
Use of Crude Extract Water–Soluble Polysaccharides of Durian (Durio zibethinus Murr) Seeds as Stabilizer for Pineapple Juice Production使用榴莲 (Durio zibethinus Murr) 种子的粗提水溶性多糖作为菠萝汁生产的稳定剂
OAAI
OAAI分享收藏Key Challenges and Opportunities for Conjunctive Management of Surface and Groundwater in Mega-Irrigation Systems: Lower Indus, Pakistan.png)
ResourcesOAAI
ResourcesIF0
OAAI分享收藏Hyperspectral Image Super-Resolution via Recurrent Feedback Embedding and SpatialSpectral Consistency Regularization基于递归反馈嵌入和空间光谱一致性正则化的高光谱图像超分辨率
PREAI
分享收藏Dilated projection correction network based on autoencoder for hyperspectral image super-resolutionNEURAL NETWORKS
NEURAL NETWORKSIF6.3
PREAI
分享收藏
A Phenomenon We Can't Ignore: Performance Improvement Interventions to Address Workplace Bullying
PREAI
分享收藏
查看更多内容