返回
Physics-informed interactive network for hyperspectral image classification
DOI:10.1016/j.infrared.2024.105425.png)
摘要
En 中文
In hyperspectral image (HSI) classification, convolutional neural networks (CNNs) have made great progress. In recent CNN-based HSI classification methods, spatial attention mechanism has been widely used to emphasize more salient features and suppress less useful ones. However, these methods tend to utilize plug-and-play attention modules which ignore the physical meaning of HSI pixels. To reflect the physical construction of HSI pixels in the attention mask, we propose a physics-informed interactive network (PI 2 Net) integrating a spatial guided spectral component stream (SGSC-stream) and a spectral constrained spatial attention stream (SCSA-stream). The SGSC-stream can obtain more expressive abundance features of the input HSI cubes through a component analysis block. The SCSA-stream completes the prediction of hyperspectral data in threestage features extraction cells and a classification cell. To connect and interact between these two streams, a component-aware attention module (CAAM) and a class-wise endmember activation gate (CWEAG) are designed. The CAAM measures the similarity of abundance features to generate a component-aware attention mask, so as to learn the component-based relationships between pixels. Then, the multiscale attention masks are embedded into different stages of the SCSA-stream. The CWEAG is proposed to iteratively generate more accurate abundance features with the classification result of SCSA-stream. Experimental results based on three common hyperspectral data sets demonstrate that PI 2 Net outperforms several state-of-the-art methods in terms of qualitative and quantitative analysis.
Keyword:
Hyperspectral image (HSI) classification
Dual-stream architecture
Convolutional neural network (CNN)
Attention mechanism
Hyperspectral unmixing
期刊
I
IF:
3.4
论文数:
5.8K
被引数:
1.2W
机构
引用论文
Caw’s Walking State Recognition Based on Accelerometers and Gyroscopes Installed on Ear-Tags and Collar-Tags基于安装在耳标和项圈上的加速度计和陀螺仪的Caw步行状态识别
Spectral-Spatial Classification of Hyperspectral Images With a Superpixel-Based Discriminative Sparse Model基于超像素判别稀疏模型的高光谱图像光谱-空间分类
Deep Pyramidal Residual Networks for Spectral-Spatial Hyperspectral Image Classification用于光谱-空间高光谱图像分类的深度金字塔残差网络
Nearest neighbor classification of remote sensing images with the maximal margin principle基于最大间隔原理的遥感图像最近邻分类

