.png){kind=icon}
Return
Multi-Task Interaction Learning for Spatiospectral Image Super-Resolution
.png){kind=icon}
PRE
AI
DOI：10.1109/TIP.2022.3161834.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
High spatial resolution and high spectral resolution images (HR-HSIs) are widely applied in geosciences, medical diagnosis, and beyond. However, how to get images with both high spatial resolution and high spectral resolution is still a problem to be solved. In this paper, we present a deep spatial-spectral feature interaction network (SSFIN) for reconstructing an HR-HSI from a low-resolution multispectral image (LR-MSI), e.g., RGB image. In particular, we introduce two auxiliary tasks, i.e., spatial super-resolution (SR) and spectral SR to help the network recover the HR-HSI better. Since higher spatial resolution can provide more detailed information about image texture and structure, and richer spectrum can provide more attribute information, we propose a spatial-spectral feature interaction block (SSFIB) to make the spatial SR task and the spectral SR task benefit each other. Therefore, we can make full use of the rich spatial and spectral information extracted from the spatial SR task and spectral SR task, respectively. Moreover, we use a weight decay strategy (for the spatial and spectral SR tasks) to train the SSFIN, so that the model can gradually shift attention from the auxiliary tasks to the primary task. Both quantitative and visual results on three widely used HSI datasets demonstrate that the proposed method achieves a considerable gain compared to other state-of-the-art methods. Source code is available at https://github.com/junjun-jiang/SSFIN.
Keywords:
Task analysis
Superresolution
Spatial resolution
Hyperspectral imaging
Correlation
Image reconstruction
Representation learning
Super-resolution
hyperspectral image
auxiliary tasks
feature interaction
Journal
IF:
13.7
Papers:
1.0W
Citations:
8.4W
Organization
Cited Papers
ShareSaveShareSaveKey Challenges and Opportunities for Conjunctive Management of Surface and Groundwater in Mega-Irrigation Systems: Lower Indus, Pakistan.png)
Resources
OAAI
ResourcesIF0
OAAIShareSaveShareSaveDilated projection correction network based on autoencoder for hyperspectral image super-resolutionNEURAL NETWORKS
NEURAL NETWORKSIF6.3
PREAI
ShareSave
ShareSaveShareSaveA Phenomenon We Can't Ignore: Performance Improvement Interventions to Address Workplace Bullying
PREAI
ShareSave
View more