.png){kind=icon}
返回
Crossmodal Sequential Interaction Network for Hyperspectral and LiDAR Data Joint Classification
.png){kind=icon}
PRE
AI
DOI：10.1109/LGRS.2024.3365715.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Numerous deep learning (DL) studies have indicated that fusing hyperspectral (HS) and light detection and ranging (LiDAR) data is effective for land-cover classification. However, the sequential characteristics (seqCHAs) in the spatial domain are always ambiguous and neglected. In this letter, we propose a deep crossmodal sequential interaction network (CsiNet) for HS and LiDAR data joint classification. We aim to verify the contributions of crossmodal seqCHAs in multimodal joint classification tasks and present an effective crossmodal sequential flattening (SF) strategy. Specifically, CsiNet sorts the neighboring samples in terms of the spectral and 3-D spatial diversities between the corresponding samples and the central one. Notably, the 3-D spatial diversity considers the shared sample positions in both modalities and the sample elevations in LiDAR data simultaneously. CsiNet is capable of extracting crossmodal sequential features comprehensively by long and short-term memory (LSTM) layers and better simulating sequential properties of samples compared with convolutional layer based networks. Experiments conducted on the Muufl Gulfport (MUUFL) and Houston 2013 datasets prove that CsiNet outperforms several state-of-the-art techniques qualitatively and quantitatively. When using 1% training samples per category, the overall accuracies of CsiNet on both datasets achieve 90.27% and 92.41% and are increased by 0.27% and 0.17% than the best comparison technique, respectively. Ablation experiments verify the effectiveness of CsiNet by replacing the crossmodal SF strategy with several alternative ones.
Keyword:
Laser radar
Three-dimensional displays
Spatial diversity
Single-photon avalanche diodes
Streams
Feature extraction
Task analysis
Crossmodal sequential characteristic (seqCHA)
hyperspectral (HS)
joint classification
light detection and ranging (LiDAR)
multimodality
期刊
IF:
16.4
论文数:
1.0W
被引数:
5.1K
机构
引用论文
.png){kind=icon}
Deep EncoderDecoder Networks for Classification of Hyperspectral and LiDAR Data用于高光谱和激光雷达数据分类的深度编码解码器网络
PREAI
分享收藏Multilevel Dual-Direction Modifying Variational Autoencoders for Hyperspectral Feature Extraction
PREAI
分享收藏Spatial Revising Variational Autoencoder-Based Feature Extraction Method for Hyperspectral Images基于空间修正变分自编码器的高光谱图像特征提取方法
PREAI
分享收藏More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification更多样化意味着更好: 多模态深度学习符合遥感影像分类
OAAI
OAAI分享收藏
查看更多内容