.png){kind=icon}
返回
State space models meet transformers for hyperspectral image classification
.png){kind=icon}
PRE
AI
DOI：10.1016/j.sigpro.2024.109669.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In recent years, convolutional neural networks and vision transformers have emerged as predominant models for hyperspectral remote sensing image classification task, leveraging staked convolution layers and self- attention mechanisms with high computation costs, respectively. Recent studies, such as the Mamba model, have showcased the ability of state space model (SSM) with efficient hardware-aware designs in efficiently modeling sequences and extracting implicit features along tokens, which is precisely needed for accurate hyperspectral image (HSI) classification. Thus making SSM-based model potentially a new architecture for remote sensing HSI classification task. However, SSM encounters challenges in modeling HSI due to the insensitivity of spatial information and redundant spectral characteristics. Given SSM-based methods rarely explored in HSI classification, in this work, we present the first exploration of SSM-based models for HSI classification task. Our proposed method MamTrans effectively leverages the capacity of transformer for capturing spatial tokens relationships and Mamba for extracting implicit features along tokens. Besides, we propose a Bidirectional Mamba Module to enhance SSM's spatial perception ability of extracting spatial features in HSI. Our proposed MamTrans obtains a new state-of-the-art performance across five commonly employed HSI classification benchmarks, demonstrating the robust generalization of MamTrans and effectiveness of SSM-based structure for HSI classification task. Our codes could be found at https://github.com/PPPPPsanG/MamTrans.
Keyword:
Hyperspectral image classification
Remote sensing
State space model
Mamba
Transformer
期刊
IF:
3.6
论文数:
10.0K
被引数:
1.7W
机构
暂无机构信息
引用论文
Density and Thermal Conductivity Measurements for Silicon Melt by Electromagnetic Levitation under a Static Magnetic Field在静态磁场下通过电磁悬浮测量硅熔体的密度和热导率
PREAI
分享收藏Three-dimensional Softmax Mechanism Guided Bidirectional GRU Networks for Hyperspectral Remote Sensing Image Classification三维Softmax机制引导的双向GRU网络用于高光谱遥感图像分类.png)
SIGNAL PROCESSING
OAAI
SIGNAL PROCESSINGIF3.6
OAAI分享收藏
查看更多内容