arrow
返回

Cross-Scope Spatial-Spectral Information Aggregation for Hyperspectral Image Super-Resolution

delete2024-01-01
delete0
delete
OA
AI
S
Shi Chen
L
Lefei Zhang *
L
Liangpei Zhang *
DOI:10.1109/TIP.2024.3468905delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Hyperspectral image super-resolution has attained widespread prominence to enhance the spatial resolution of hyperspectral images. However, convolution-based methods have encountered challenges in harnessing the global spatial-spectral information. The prevailing transformer-based methods have not adequately captured the long-range dependencies in both spectral and spatial dimensions. To alleviate this issue, we propose a novel cross-scope spatial-spectral Transformer (CST) to efficiently investigate long-range spatial and spectral similarities for single hyperspectral image super-resolution. Specifically, we devise cross-attention mechanisms in spatial and spectral dimensions to comprehensively model the long-range spatial-spectral characteristics. By integrating global information into the rectangle-window self-attention, we first design a cross-scope spatial self-attention to facilitate long-range spatial interactions. Then, by leveraging appropriately characteristic spatial-spectral features, we construct a cross-scope spectral self-attention to effectively capture the intrinsic correlations among global spectral bands. Finally, we elaborate a concise feed-forward neural network to enhance the feature representation capacity in the Transformer structure. Extensive experiments over three hyperspectral datasets demonstrate that the proposed CST is superior to other state-of-the-art methods both quantitatively and visually. The code is available at https://github.com/Tomchenshi/CST.git.
Keyword:
Hyperspectral image
super-resolution
deep learning
transformer
Hyperspectral image
super-resolution
deep learning
transformer

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

W
wuhan university
学者数:
8.1W
论文数: 5.8W
被引数: 70
引用论文

引用论文

Monitoring as strategy for planned conservation: the case of Sant’Andrea in Mantova (Mantua)
err2018-09-29
err0
errOAAI
errLuigi Fregonese; Elisabetta Rosina; Andrea Adami; Marta Caterina Bottacchi; Elena Romoli; Daniela Lattanzi
err分享
err收藏
Amostragem para avaliação da fertilidade do solo em função da variabilidade de suas características químicas
err2009-12-01
err0
errOAAI
errHemmannuella C. Santos; Fábio H. T. de Oliveira; Jandeilson A. de Arruda; Almir R. da S. Lopes; Reginaldo F. de Souza Júnior; Daise R. de Farias
err分享
err收藏
Noise Prior Knowledge Informed Bayesian Inference Network for Hyperspectral Super-Resolution
err2023-01-01
err4
PREAI
errDong, Wenqian; Qu, Jiahui; Xiao, Song; Zhang, Tongzhen; Li, Yunsong; Jia, Xiuping
err分享
err收藏
Novel de novo variant in EBF3 is likely to impact DNA binding in a patient with a neurodevelopmental disorder and expanded phenotypes: patient report, in silico functional assessment, and review of published cases
err2017-03-10
err0
errOAAI
errPatrick R. Blackburn; Sarah S. Barnett; Michael T. Zimmermann; Margot A. Cousin; Charu Kaiwar; Filippo Pinto e Vairo; Zhiyv Niu; Matthew J. Ferber; Raul A. Urrutia; Duygu Selcen; Eric W. Klee; Pavel N. Pichurin
err分享
err收藏
学者 查看更多内容