.png){kind=icon}
返回
Multimodal Quaternion Representation Network for Multisource Remote Sensing Data Classification
.png){kind=icon}
PRE
AI
DOI：10.1109/TNNLS.2025.3610892.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The effective integration and classification of hyperspectral images (HSIs) and light detection and ranging (LiDAR) data is of great significance in Earth observation missions, which are confronted with challenges such as insufficient information utilization and feature heterogeneity. This article proposes a multimodal quaternion representation network (MMQRN) for multisource remote sensing (RS) data classification. Specifically, we first propose the multimodal quaternion representation (MMQR), which employs the orthogonal imaginary components of quaternions to model the complex nonlinear interactions among complementary features, thereby enabling their comprehensive fusion and utilization. Subsequently, we design a multimodal feature cross-fusion (MFCF) framework to integrate multisource, multimodal, and multilevel features adequately. Finally, we leverage the ability to capture long-term dependencies of transformers to design a quaternion convolutional transformer network (QCTN) for modeling global and local spatial–spectral information, respectively. Experiments conducted on three multisource RS datasets demonstrate the superior performance of the proposed MMQRN relative to other state-of-the-art classification methods.
Keyword:
Hyperspectral image (HSI)
light detection and ranging (LiDAR)
multimodal feature
multisource classification
quaternion
transformer
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
.png){kind=icon}
Earth Observation Imaging Spectroscopy for Terrestrial Systems: An Overview of Its History, Techniques, and Applications of Its Missions地面系统的地球观测成像光谱学: 其任务的历史，技术和应用概述
PREAI
分享收藏3-D Gabor Convolutional Neural Network for Hyperspectral Image Classification用于高光谱图像分类的三维Gabor卷积神经网络
PREAI
分享收藏Multiattention Joint Convolution Feature Representation With Lightweight Transformer for Hyperspectral Image Classification基于轻量级变换器的多注意力联合卷积特征表示高光谱图像分类
PREAI
分享收藏
查看更多内容