返回
Multiscale Deep Learning Network With Self-Calibrated Convolution for Hyperspectral and LiDAR Data Collaborative Classification
DOI:10.1109/TGRS.2021.3106025.png)
摘要
En 中文
In this article, we propose a novel multiscale deep learning network with self-calibrated convolution (MSNetSC) for hyperspectral and light detection and ranging (LiDAR) data collaborative classification. Conventional deep learning methods have limitations in extracting multiscale features at a granular level from multimodality data and fusing these features in a context-awareness way, which will severely restrict the performance of hyperspectral and LiDAR data joint classification. The proposed multiscale deep learning network utilizes a hierarchical residual structure combined with self-calibrated convolution to extract features with different receptive fields, and this can enhance the model's capability to represent the multimodality data. Besides, we employ spectral and spatial self-attention modules to adaptively calibrate weights of features with different scales, thereby enhancing the discriminative ability of extracted multiscale features. Furthermore, the attentional feature fusion module can dynamically and adaptively fuse the features from multimodality data in a contextual scale-aware way, and this attention-based feature fusion method will further improve the collaborative classification performance of hyperspectral and LiDAR data. Four benchmark multimodality data (i.e., hyperspectral and LiDAR data) sets collected by different sensors and at different acquisition times are employed for joint classification experiments. These comparative classification results and ablation study sufficiently certify the superiority of the proposed model in terms of collaborative classification accuracy when compared with other state-of-the-art methods.
Keyword:
Feature extraction
Laser radar
Hyperspectral imaging
Data mining
Convolution
Collaboration
Fuses
Attentional feature fusion (AFF)
collaborative classification
hierarchical residual network
hyperspectral image (HSI)
light detection and ranging (LiDAR)
self-calibrated convolution
期刊
IF:
8.6
论文数:
2.2W
被引数:
10.7W
机构
引用论文
Synthesis of n-type semiconducting diamond film using diphosphorus pentaoxide as the doping source以五氧化二磷为掺杂源合成n型半导体金刚石膜
Deep EncoderDecoder Networks for Classification of Hyperspectral and LiDAR Data用于高光谱和激光雷达数据分类的深度编码解码器网络

