arrow
返回

Physics-informed interactive network for hyperspectral image classification

delete2024-09-01
delete1
PRE
AI
L
Liangyu Zhou
S
Sen Li
X
Xiaoyan Luo *
R
Rui Xue *
DOI:10.1016/j.infrared.2024.105425delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In hyperspectral image (HSI) classification, convolutional neural networks (CNNs) have made great progress. In recent CNN-based HSI classification methods, spatial attention mechanism has been widely used to emphasize more salient features and suppress less useful ones. However, these methods tend to utilize plug-and-play attention modules which ignore the physical meaning of HSI pixels. To reflect the physical construction of HSI pixels in the attention mask, we propose a physics-informed interactive network (PI 2 Net) integrating a spatial guided spectral component stream (SGSC-stream) and a spectral constrained spatial attention stream (SCSA-stream). The SGSC-stream can obtain more expressive abundance features of the input HSI cubes through a component analysis block. The SCSA-stream completes the prediction of hyperspectral data in threestage features extraction cells and a classification cell. To connect and interact between these two streams, a component-aware attention module (CAAM) and a class-wise endmember activation gate (CWEAG) are designed. The CAAM measures the similarity of abundance features to generate a component-aware attention mask, so as to learn the component-based relationships between pixels. Then, the multiscale attention masks are embedded into different stages of the SCSA-stream. The CWEAG is proposed to iteratively generate more accurate abundance features with the classification result of SCSA-stream. Experimental results based on three common hyperspectral data sets demonstrate that PI 2 Net outperforms several state-of-the-art methods in terms of qualitative and quantitative analysis.
Keyword:
Hyperspectral image (HSI) classification
Dual-stream architecture
Convolutional neural network (CNN)
Attention mechanism
Hyperspectral unmixing

期刊

I
Infrared Physics and Technology
IF:
3.4
论文数:
5.8K
被引数:
1.2W

机构

B
Beihang University
学者数:
5.2W
论文数: 4.1W
被引数: 37
引用论文

引用论文

err分享
err收藏
Stacked Autoencoder-based deep learning for remote-sensing image classification: a case study of African land-cover mapping
err2016-10-31
err157
PREAI
errLi, Weijia; Fu, Haohuan; Yu, Le; Gong, Peng; Feng, Duole; Li, Congcong; Clinton, Nicholas
err分享
err收藏
学者 查看更多内容