返回
A Cross-Level Spectral-Spatial Joint Encode Learning Framework for Imbalanced Hyperspectral Image Classification
DOI:10.1109/TGRS.2022.3203980.png)
摘要
En 中文
Convolutional neural networks (CNNs) have dominated the research of hyperspectral image (HSI) classification, attributing to the superior feature representation capacity. Fast patch-free global learning (FPGA) as a fast learning framework for HSI classification has received wide interest. Despite their promising results from the perspective of fast inference, recent works have difficulty modeling spectral-spatial relationships with imbalanced samples. In this article, we revisit the encoder-decoder-based fully convolutional network (FCN) and propose a cross-level spectral-spatial joint encoding (CLSJE) framework for imbalanced HSI classification. First, a multiscale input encoder and multiple-to-one multiscale features connection are introduced to obtain abundant features and facilitate multiscale contextual information flow between the encoder and the decoder. Second, in the encoder layer, we propose the spectral-spatial joint attention (SSJA) mechanism consisting of high-frequency spatial attention (HFSA) and spectral-transform channel attention (STCA). HFSA and STCA encode spectral-spatial features jointly to improve the learning of the discriminative spectral-spatial features. Powered by these two components, CLSJE enjoys a high capability to capture both spatial and spectral dependencies for HSI classification. Besides, a class-proportion sampling strategy is developed to increase the attention to insufficiency samples. Extensive experiments demonstrate the superiority of our proposed CLSJE both at classification accuracy and inference speed, and show the state-of-the-art results on four benchmark datasets. Code can be obtained at https://github.com/yudadabing/CLSJE.
Keyword:
Feature extraction
Convolutional neural networks
Training
Hyperspectral imaging
Frequency modulation
Field programmable gate arrays
Computational modeling
Cross-level feature aggregation (CLA)
hyperspectral image (HSI) classification
imbalanced samples
inverse-weighted loss
spectral-spatial joint attention (SSJA)
期刊
IF:
8.6
论文数:
2.1W
被引数:
10.7W
机构
引用论文
Mechanical and corrosion behavior of Cu, Cr, Ni and Zn electroplating on corten A588 steel for scope for betterment in ambient construction applications在corten A588钢上电镀Cu,Cr,Ni和Zn的机械和腐蚀行为,以改善环境中的应用
Reproducibility of radiomics quality score: an intra- and inter-rater reliability study影像组学质量评分的可重复性: 评分者内部和评分者之间的可靠性研究
EUROPEAN RADIOLOGY
IF4.7

