1
Return

Dual-branch attention network with multi-level spectral-spatial fusion for hyperspectral image classification

delete2026-05-23
delete0
PRE
AI
D
Dong, Liang
D
Dang, Yuanlin
L
Lei Zhu *
杨晓非 cover
杨晓非 (Xiaofei Yang)
DOI:10.1016/j.knosys.2026.115983delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Hyperspectral image (HSI) classification is a challenging task due to the high dimensionality of spectral data and complex correlations between spectral and spatial domains. Existing approaches generally assign uniform weights to all bands and apply shallow fusion, limiting the exploitation of discriminative information and introducing redundancy. To address these limitations, we propose a dual-branch multi-level spectral-spatial feature fusion (DMSSFF) network. The proposed model integrates Transformer and convolutional neural networks (CNNs) to jointly enhance spectral-spatial representations. A grouped cross-block interactive self-attention (GCISA) branch extracts detailed spectral features and learns representations sensitive to similarity, while a multi-layer shifted window spatial feature enhancement (SW-SFE) branch captures multi-scale spatial-spectral dependencies. An efficient depth-weighted cross-attention fusion (E-DCF) module further integrates the complementary features through adaptive attention and weighting. Experiments on three benchmark datasets demonstrate that DMSSFF achieves superior accuracy over state-of-the-art methods, confirming its ability to effectively capture and fuse spectral-spatial knowledge for robust HSI classification. The corresponding code is available at https://github.com/cgma-1/DMSSFF.
Keywords:
Grouped self-attention
Shifted-window spatial enhancement
Depth-weighted spectral-spatial fusion
CNN-transformer
Hyperspectral image classification

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.2W
Citations:
4.5W

Organization

G
Guangzhou University
Scholars:
1.7W
Papers: 1.2W
Citations: 1.8W
Q
qiqihar university
Scholars:
590
Papers: 162
Citations: 0
Cited Papers

Cited Papers

Citing Papers

Citing Papers