arrow
返回

A Cross-Level Spectral-Spatial Joint Encode Learning Framework for Imbalanced Hyperspectral Image Classification

delete2022-01-01
delete7
PRE
AI
D
Dabing Yu
Q
Qingwu Li *
X
Xiaolin Wang
C
Chang Xu
Y
Yaqin Zhou
DOI:10.1109/TGRS.2022.3203980delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Convolutional neural networks (CNNs) have dominated the research of hyperspectral image (HSI) classification, attributing to the superior feature representation capacity. Fast patch-free global learning (FPGA) as a fast learning framework for HSI classification has received wide interest. Despite their promising results from the perspective of fast inference, recent works have difficulty modeling spectral-spatial relationships with imbalanced samples. In this article, we revisit the encoder-decoder-based fully convolutional network (FCN) and propose a cross-level spectral-spatial joint encoding (CLSJE) framework for imbalanced HSI classification. First, a multiscale input encoder and multiple-to-one multiscale features connection are introduced to obtain abundant features and facilitate multiscale contextual information flow between the encoder and the decoder. Second, in the encoder layer, we propose the spectral-spatial joint attention (SSJA) mechanism consisting of high-frequency spatial attention (HFSA) and spectral-transform channel attention (STCA). HFSA and STCA encode spectral-spatial features jointly to improve the learning of the discriminative spectral-spatial features. Powered by these two components, CLSJE enjoys a high capability to capture both spatial and spectral dependencies for HSI classification. Besides, a class-proportion sampling strategy is developed to increase the attention to insufficiency samples. Extensive experiments demonstrate the superiority of our proposed CLSJE both at classification accuracy and inference speed, and show the state-of-the-art results on four benchmark datasets. Code can be obtained at https://github.com/yudadabing/CLSJE.
Keyword:
Feature extraction
Convolutional neural networks
Training
Hyperspectral imaging
Frequency modulation
Field programmable gate arrays
Computational modeling
Cross-level feature aggregation (CLA)
hyperspectral image (HSI) classification
imbalanced samples
inverse-weighted loss
spectral-spatial joint attention (SSJA)

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.1W
被引数:
10.7W

机构

H
Hohai University
学者数:
2.3W
论文数: 1.8W
被引数: 2.1W
引用论文

引用论文

err分享
err收藏
Reproducibility of radiomics quality score: an intra- and inter-rater reliability study影像组学质量评分的可重复性: 评分者内部和评分者之间的可靠性研究
err2023-09-21
err26
errOAAI
errCavallo, Armando Ugo; Stanzione, Arnaldo; Klontzas, Michail E.; Ugga, Lorenzo; Baran, Agah; Fanni, Salvatore Claudio; Petrash, Ekaterina; Ambrosini, Ilaria; Cappellini, Luca Alessandro; Kotter, Elmar; Dos Santos, Daniel Pinto
err分享
err收藏
Cascaded Recurrent Neural Networks for Hyperspectral Image Classification
err2019-08-01
err442
errOAAI
errHang, Renlong; Liu, Qingshan; Hong, Danfeng; Ghamisi, Pedram
err分享
err收藏
Deep Learning for Hyperspectral Image Classification: An Overview用于高光谱图像分类的深度学习: 综述
err2019-09-01
err1.3K
errOAAI
errLi, Shutao; Song, Weiwei; Fang, Leyuan; Chen, Yushi; Ghamisi, Pedram; Benediktsson, Jon Atli
err分享
err收藏
Generalized Composite Kernel Framework for Hyperspectral Image Classification
err2013-09-01
err458
PREAI
errLi, Jun; Marpu, Prashanth Reddy; Plaza, Antonio; Bioucas-Dias, Jose M.; Benediktsson, Jon Atli
err分享
err收藏
学者 查看更多内容