返回
Graph Guided Transformer: An Image-Based Global Learning Framework for Hyperspectral Image Classification
DOI:10.1109/LGRS.2023.3316732.png)
摘要
En 中文
Hyperspectral image (HSI) classification methods often follow an approach of patch-based learning framework. Recently, an image-based global deep learning framework has gained increasing attention for HSI classification tasks due to faster inference speed. However, such a framework exhibits deteriorated performance in modeling features on the region level while balancing local spatial structure information. In this letter, we propose a global learning method that includes graph-guided transformer (G(2)T) as the core tool. First, we extract pixel level features by convolution block and obtain an undirected graph by segmentation on superpixel scales for an input HSI. Then, to model global and local correlations among nodes of superpixels, a mechanism of graph-guided self-attention (G(2)SA) is developed and implemented. Finally, pixel level features integrated with superpixel features at regional level are used to generate classification results for the HSI. Experimental results demonstrate that the method of G(2)T outperforms state-of-the-art methods in classification accuracy and inference speed, in particular in the case of limited labeled sample.
Keyword:
Transformers
Feature extraction
Training
Convolutional neural networks
Data mining
Task analysis
Correlation
Convolutional neural network (CNN)
graph guided self-attention (G(2)) mechanism
graph transformer
hyperspectral image (HSI) classification
期刊
IF:
16.4
论文数:
1.0W
被引数:
5.1K
机构
引用论文
MSTNet: A Multilevel Spectral-Spatial Transformer Network for Hyperspectral Image ClassificationMSTNet: 用于高光谱图像分类的多级光谱-空间变换器网络
Weighted Feature Fusion of Convolutional Neural Network and Graph Attention Network for Hyperspectral Image Classification卷积神经网络与图注意力网络加权特征融合的高光谱图像分类

