返回
Dilated Deep MPFormer Network for Hyperspectral Image Classification
DOI:10.1109/LGRS.2024.3393290.png)
摘要
En 中文
Hyperspectral image (HSI) possesses distinctive advantages in the classification of materials due to its rich spectral information. Convolutional neural network (CNN) and vision transformer (ViT), as mainstream methodologies, have demonstrated significant success. However, they often ignore subtle spectral differences, leading to the inadequate utilization of the spectral information. In this letter, we present a novel feature extraction and classification method, i.e., dilated deep MPFormer network (DDMN), which takes the inherent advantages of CNN and ViT while enhancing the exploitation of spectral information. First, the dilated depthwise separable convolution (DDSC) is proposed to expand the channel dimension, enabling the capture of subtle spectral differences among similar materials. Second, a sequence of improved transformers, i.e., MPFormer, are adopted to effectively extract spatial-spectral features, in which a new multiscale pooling mixer (MPMixer) is designed to replace the attention module in ViT, resulting in reduced parameter numbers and accelerated training speed. Finally, an adaptive weighted fusion module (AWFM) is developed to improve the interaction between specific texture features in shallow layers and abstract semantic features in deep layers. Extensive experiments demonstrate that the proposed DDMN method achieves improvements in OA of 0.8%, 1.04%, and 1.99% when compared to SOTA methods on three HSI datasets of LK, PU, and HS, respectively.
Keyword:
Feature extraction
Convolution
Training
Kernel
Convolutional neural networks
Transformers
Testing
Convolutional neural network (CNN)
hyperspectral image (HSI) classification
vision transformer (ViT)
期刊
IF:
16.4
论文数:
1.0W
被引数:
5.1K
机构
引用论文
Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍?
Breaking the Silence of Tumor Response: Future Prospects of Targeted Radionuclide
Therapy打破肿瘤反应的沉默: 靶向放射性核素的未来前景
治疗
Multi-Complementary Generative Adversarial Networks With Contrastive Learning for Hyperspectral Image Classification基于对比学习的多互补生成对抗网络高光谱图像分类

