arrow
返回

Few-Shot Hyperspectral Image Classification With Self-Supervised Learning

delete2023-01-01
delete25
PRE
AI
Z
Zhaokui Li *
H
Hui Guo
陈
陈雨时 (Yushi Chen)
刘翠微 封面图
刘翠微 (Cuiwei Liu)
Q
Qian Du
Z
Zhuoqun Fang
Y
Yan Wang
DOI:10.1109/TGRS.2023.3298851delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recently, few-shot learning (FSL) has been introduced for hyperspectral image (HSI) classification with few labeled samples. However, existing FSL-based HSI classification methods mainly focus on the meta-knowledge transfer between HSIs. Compared with HSIs, natural images have sufficient annotated data. To utilize natural images (base class data) to achieve accurate classification of HSIs (novel class data), we propose a novel few-shot classification framework with SSL (FSCF-SSL) for HSIs in this article. The orientation of objects in natural images is relatively unitary, whereas the objects of image patches for each pixel in HSIs have diverse orientations in the spatial domain. To make better use of base classes, we design an SSL with geometric transformations (SSLGTs), which sets rotation labels as supervision to extract low-level features that can better represent diverse orientations, and then conduct SSLGT and FSL on base classes to learn transferable spatial meta-knowledge. Next, a spectral-spatial feature extraction network is carefully designed to better utilize the spatial and spectral information of HSIs, where the weights of the first seven layers of the spatial part are initialized by the weights of the corresponding layers trained on base classes. Finally, to fully explore the few annotated data from novel classes, we design an SSL with contrastive learning (SSLCL) that can mine the category-invariant features contained in the novel class data itself, and then perform SSLCL and FSL on novel classes to learn more discriminative individual knowledge. Experimental results on four HSI datasets show that FSCF-SSL offers a significant improvement over state-of-the-art methods. The code is available at https://github.com/Li-ZK/FSCF-SSL-2023.
Keyword:
Contrastive learning (CL)
few-shot learning (FSL)
hyperspectral image (HSI) classification
self-supervised learning (SSL)

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.1W
被引数:
10.7W

机构

H
harbin institute of technology
学者数:
8.0W
论文数: 6.6W
被引数: 66
S
Shenyang Aerospace University
学者数:
3.1K
论文数: 1.9K
被引数: 2.0K
M
mississippi state university
学者数:
7.4K
论文数: 6.9K
被引数: 70
学者 查看更多机构
引用论文

引用论文

Hyperspectral Image Classification With Deep Learning Models基于深度学习模型的高光谱图像分类
err2018-09-01
err356
PREAI
errYang, Xiaofei; Ye, Yunming; Li, Xutao; Lau, Raymond Y. K.; Zhang, Xiaofeng; Huang, Xiaohui
err分享
err收藏
Active Learning Methods for Remote Sensing Image Classification
err2009-07-01
err432
PREAI
errTuia, Devis; Ratle, Frederic; Pacifici, Fabio; Kanevski, Mikhail F.; Emery, William J.
err分享
err收藏
Heterogeneous Few-Shot Learning for Hyperspectral Image Classification基于异构少镜头学习的高光谱图像分类
err2022-01-01
err66
PREAI
errWang, Yan; Liu, Ming; Yang, Yuexin; Li, Zhaokui; Du, Qian; Chen, Yushi; Li, Fei; Yang, Haibo
err分享
err收藏
Deep Learning for Hyperspectral Image Classification: An Overview用于高光谱图像分类的深度学习: 综述
err2019-09-01
err1.3K
errOAAI
errLi, Shutao; Song, Weiwei; Fang, Leyuan; Chen, Yushi; Ghamisi, Pedram; Benediktsson, Jon Atli
err分享
err收藏
DC discharge plasma studies for nanostructured carbon CVD
err2003-03-01
err0
PREAI
errA.N. Obraztsov; A.A. Zolotukhin; A.O. Ustinov; A.P. Volkov; Yu. Svirko; K. Jefimovs
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容