arrow
返回

Dilated Deep MPFormer Network for Hyperspectral Image Classification

delete2024-01-01
delete2
PRE
AI
M
Mengkun He
黄薇 封面图
黄薇 (Wei Huang)
朱付保 封面图
朱付保 (Fubao Zhu)
DOI:10.1109/LGRS.2024.3393290delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Hyperspectral image (HSI) possesses distinctive advantages in the classification of materials due to its rich spectral information. Convolutional neural network (CNN) and vision transformer (ViT), as mainstream methodologies, have demonstrated significant success. However, they often ignore subtle spectral differences, leading to the inadequate utilization of the spectral information. In this letter, we present a novel feature extraction and classification method, i.e., dilated deep MPFormer network (DDMN), which takes the inherent advantages of CNN and ViT while enhancing the exploitation of spectral information. First, the dilated depthwise separable convolution (DDSC) is proposed to expand the channel dimension, enabling the capture of subtle spectral differences among similar materials. Second, a sequence of improved transformers, i.e., MPFormer, are adopted to effectively extract spatial-spectral features, in which a new multiscale pooling mixer (MPMixer) is designed to replace the attention module in ViT, resulting in reduced parameter numbers and accelerated training speed. Finally, an adaptive weighted fusion module (AWFM) is developed to improve the interaction between specific texture features in shallow layers and abstract semantic features in deep layers. Extensive experiments demonstrate that the proposed DDMN method achieves improvements in OA of 0.8%, 1.04%, and 1.99% when compared to SOTA methods on three HSI datasets of LK, PU, and HS, respectively.
Keyword:
Feature extraction
Convolution
Training
Kernel
Convolutional neural networks
Transformers
Testing
Convolutional neural network (CNN)
hyperspectral image (HSI) classification
vision transformer (ViT)

期刊

IEEE Geoscience and Remote Sensing Magazine 封面图
IEEE Geoscience and Remote Sensing Magazine
IF:
16.4
论文数:
1.0W
被引数:
5.1K

机构

Z
Zhengzhou University of Light Industry
学者数:
6.4K
论文数: 4.0K
被引数: 5.4K
引用论文

引用论文

Quantifying Gender Bias in Consumer Culture
err2022-01-01
err0
errOAAI
errReihane Boghrati; Jonah A. Berger
err分享
err收藏
Advanced Spectral Classifiers for Hyperspectral Images A review
err2017-03-01
err509
errOAAI
errGhamisi, Pedram; Plaza, Javier; Chen, Yushi; Li, Jun; Plaza, Antonio
err分享
err收藏
学者 查看更多内容