arrow
返回

Multiscale Deep Learning Network With Self-Calibrated Convolution for Hyperspectral and LiDAR Data Collaborative Classification

delete2022-01-01
delete43
PRE
AI
Z
Zhixiang Xue *
X
Xuchu Yu
X
Xiong Tan
B
Bing Liu
A
Anzhu Yu
DOI:10.1109/TGRS.2021.3106025delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this article, we propose a novel multiscale deep learning network with self-calibrated convolution (MSNetSC) for hyperspectral and light detection and ranging (LiDAR) data collaborative classification. Conventional deep learning methods have limitations in extracting multiscale features at a granular level from multimodality data and fusing these features in a context-awareness way, which will severely restrict the performance of hyperspectral and LiDAR data joint classification. The proposed multiscale deep learning network utilizes a hierarchical residual structure combined with self-calibrated convolution to extract features with different receptive fields, and this can enhance the model's capability to represent the multimodality data. Besides, we employ spectral and spatial self-attention modules to adaptively calibrate weights of features with different scales, thereby enhancing the discriminative ability of extracted multiscale features. Furthermore, the attentional feature fusion module can dynamically and adaptively fuse the features from multimodality data in a contextual scale-aware way, and this attention-based feature fusion method will further improve the collaborative classification performance of hyperspectral and LiDAR data. Four benchmark multimodality data (i.e., hyperspectral and LiDAR data) sets collected by different sensors and at different acquisition times are employed for joint classification experiments. These comparative classification results and ablation study sufficiently certify the superiority of the proposed model in terms of collaborative classification accuracy when compared with other state-of-the-art methods.
Keyword:
Feature extraction
Laser radar
Hyperspectral imaging
Data mining
Convolution
Collaboration
Fuses
Attentional feature fusion (AFF)
collaborative classification
hierarchical residual network
hyperspectral image (HSI)
light detection and ranging (LiDAR)
self-calibrated convolution

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.2W
被引数:
10.7W

机构

P
pla information engineering university
学者数:
2.8K
论文数: 1.6K
被引数: 2
引用论文

引用论文

err分享
err收藏
Deep Learning for Hyperspectral Image Classification: An Overview用于高光谱图像分类的深度学习: 综述
err2019-09-01
err1.3K
errOAAI
errLi, Shutao; Song, Weiwei; Fang, Leyuan; Chen, Yushi; Ghamisi, Pedram; Benediktsson, Jon Atli
err分享
err收藏
Synthesis of n-type semiconducting diamond film using diphosphorus pentaoxide as the doping source以五氧化二磷为掺杂源合成n型半导体金刚石膜
err1990-10-01
err0
PREAI
errKen Okano; Hideo Kiyota; Tatsuya Iwasaki; Yoshitaka Nakamura; Yukio Akiba; Tateki Kurosu; Masamori Iida; Terutaro Nakamura
err分享
err收藏
Invariant Attribute Profiles: A Spatial-Frequency Joint Feature Extractor for Hyperspectral Image Classification
err2020-06-01
err262
errOAAI
errHong, Danfeng; Wu, Xin; Ghamisi, Pedram; Chanussot, Jocelyn; Yokoya, Naoto; Zhu, Xiao Xiang
err分享
err收藏
学者 查看更多内容