.png){kind=icon}
返回
A multi-range spectral-spatial transformer for hyperspectral image classification
.png){kind=icon}
PRE
AI
DOI：10.1016/j.infrared.2023.104983.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In recent years, the transformer-based approach becoming a hot research topic in hyperspectral image (HSI) classification tasks. However, most of these studies have focused on optimizing the model framework in pursuit of high-accuracy classification, with little attention to the composition of the input token sequence as an important factor affecting the performance of the transformer. Therefore, this paper further explores a novel token structure to strengthen the Transformer's performance for HSI classification tasks, based on which a Multi-Range Spectral-Spatial Transformer (MRSST) framework is developed. Specifically, a convolutional feature pre-encoder with two branches is designed to extract shallow features for each spectral channel separately. Then, a token generator is introduced to combine the shallow features with the raw spectral information to yield the token sequences with multi-range information. Finally, the tokens are input into the transformer encoders enhanced by a module that strengthens the information exchange between its mid-range and short-range se-mantic features. Experiments conducted on three well-known hyperspectral datasets demonstrate that the pro-posed multi-range composite token sequences and information exchange mechanisms significantly enhance the transformer's performance. Codes are released at: https://github.com/HyperSystemAndImageProc/Multi-Range-Spectral-Spatial-Transformer.
Keyword:
Hyperspectral image classification
Transformer
Convolutional neural network (CNN)
Remote sensing
Composite token sequences
期刊
I
IF:
3.4
论文数:
5.8K
被引数:
1.2W
机构
引用论文
Molecular and Pharmacological Characterization of GABAA Receptors in the Rat Pituitary大鼠垂体中GABAA 受体的分子和药理学特征
.png){kind=icon}
PREAI
分享收藏Deep Pyramidal Residual Networks for Spectral-Spatial Hyperspectral Image Classification用于光谱-空间高光谱图像分类的深度金字塔残差网络
OAAI
OAAI分享收藏
分享收藏
查看更多内容