.png){kind=icon}
返回
GraphGST: Graph Generative Structure-Aware Transformer for Hyperspectral Image Classification
.png){kind=icon}
PRE
AI
DOI：10.1109/TGRS.2023.3349076.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Transformer holds significance in deep learning (DL) research. Node embedding (NE) and positional encoding (PE) are usually two indispensable components in a Transformer. The former can excavate hidden correlations from the data, while the latter can store locational relationships between nodes. Recently, the Transformer has been applied for hyperspectral image (HSI) classification because the model can capture long-range dependencies to aggregate global features for representation learning. In an HSI, adjacent pixels tend to be homogeneous, while the NE does not identify the positional information of pixels. Therefore, PE is crucial for Transformers to understand locational relationships between pixels. However, in this area, most Transformer-based methods randomly generate PEs without considering their physical meaning, which leads to weak representations. This article proposes a new graph generative structure-aware Transformer (GraphGST) to solve the above-mentioned PE problem when implementing HSI classification. In our GraphGST, a new absolute PE (APE) is established to acquire pixels' absolute positional sequences (APSs) and is integrated into the Transformer architecture. Moreover, a generative mechanism with self-supervised learning is developed to achieve cross-view contrastive learning (CL), aiming to enhance the representation learning of the Transformer. The proposed GraphGST model can capture local-to-global correlations, and the extracted APSs can complement the spectral features of pixels to assist in NE. Several experiments with real HSIs are conducted to evaluate the effectiveness of our GraphGST. The proposed method demonstrates very competitive performance compared with other state-of-the-art (SOTA) approaches. Our source codes will be provided in the following link https://github.com/yuanchaosu/TGRS-graphGST.
Keyword:
Contrastive learning (CL)
graph representation learning
hyperspectral image (HSI) classification
transformer
期刊
IF:
8.6
论文数:
2.1W
被引数:
10.7W
机构
引用论文
Patterns of sexual, bilateral and interpopulational variation in human femoral neck‐shaft angles
OAAI
.png){kind=icon}
OAAI分享收藏Interpretable Hyperspectral Artificial Intelligence: When nonconvex modeling meets hyperspectral remote sensing可解释的高光谱人工智能: 当非凸建模遇到高光谱遥感时
PREAI
分享收藏Deep Pyramidal Residual Networks for Spectral-Spatial Hyperspectral Image Classification用于光谱-空间高光谱图像分类的深度金字塔残差网络OAAI
OAAI分享收藏Multiattention Joint Convolution Feature Representation With Lightweight Transformer for Hyperspectral Image Classification基于轻量级变换器的多注意力联合卷积特征表示高光谱图像分类
PREAI
分享收藏Hyperspectral and LiDAR Data Classification Based on Structural Optimization Transmission基于结构优化传输的高光谱与激光雷达数据分类
PREAI
分享收藏So what if ChatGPT wrote it? Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy如果ChatGPT写了呢？多学科视角的机遇，挑战和生成会话AI对研究，实践和政策的影响OAAI
OAAI分享收藏
查看更多内容