arrow
返回

Multiform Ensemble Self-Supervised Learning for Few-Shot Remote Sensing Scene Classification

delete2023-01-01
delete34
PRE
AI
J
Jianzhao Li
M
Maoguo Gong *
H
Huilin Liu
Y
Yourun Zhang
M
Mingyang Zhang
Y
Yue Wu
DOI:10.1109/TGRS.2023.3234252delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Self-supervised learning is an effective way to solve model collapse for few-shot remote sensing scene classification (FSRSSC). However, most self-supervised contrastive learning auxiliary tasks perform poorly on the high interclass similarity problem in FSRSSC. Furthermore, it is time-consuming and computationally expensive to obtain the best combination among numerous self-supervised auxiliary tasks. In practical applications, we may encounter difficulties in remote sensing data acquisition and labeling, while most FSRSSC studies only focus on the former. To alleviate the above problems, we propose a multiform ensemble self-supervised learning ((MESL)-L-2) framework for FSRSSC in this article. Based on the transfer learning-based few-shot scheme, we design a novel global-local contrastive learning auxiliary task to solve the low interclass separability problem. The self-attention mechanism is designed in the local contrast features to investigate the intrinsic associations between different remote sensing scene objectives. We also present a multiform ensemble enhancement (MEE) training method. Ensemble enhancement involves the concatenation of features extracted from different backbones trained by a combination of multiform self-supervised auxiliary tasks. MEE can not only be regarded as a more straightforward alternative to knowledge distillation but also can achieve an effective compromise between expensive computational cost and classification accuracy. In addition, we provide two scene classification schemes of inductive and transductive settings, corresponding to solving the difficulties of remote sensing data acquisition and labeling. The proposed network achieves state-of-the-art results on three benchmark FSRSSC datasets. The potential of the (MESL)-L-2 framework is also demonstrated in combination with classical metalearning-based and metric learning-based few-shot algorithms.
Keyword:
Few-shot learning
global-local contrastive learning
remote sensing scene classification
self-supervised learning

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.2W
被引数:
10.7W

机构

X
Xidian University
学者数:
2.4W
论文数: 1.9W
被引数: 9.7K
引用论文

引用论文

err分享
err收藏
A cancer pharmacogenomic screen powering crowd-sourced advancement of drug combination prediction
err
IF0
err2017-10-09
err0
errOAAI
errMichael P Menden; Dennis Wang; Yuanfang Guan; Mike J Mason; Bence Szalai; Krishna C Bulusu; Thomas Yu; Jaewoo Kang; Minji Jeon; Russ Wolfinger; Tin Nguyen; Mikhail Zaslavskiy; Sock Jang; Zara Ghazoui; Mehmet Eren Ahsen; Robert Vogel; Elias Chaibub Neto; Thea Norman; Eric KY Tang; Mathew J Garnett; Giovanni Di Veroli; Stephen Fawell; Gustavo Stolovitzky; Justin Guinney; Jonathan R. Dry; Julio Saez-Rodriguez
err分享
err收藏
err分享
err收藏
Field Verification of Original and Updated National Wetlands Inventory Maps in three Metropolitan Areas in Illinois, USA
err2016-10-11
err0
PREAI
errJeffrey W. Matthews; Dennis Skultety; Bradley Zercher; Michael P. Ward; Thomas J. Benson
err分享
err收藏
Structural Analysis of Chi1 Chitinase from Yen-Tc: The Multisubunit Insecticidal ABC Toxin Complex of Yersinia entomophaga
err2012-01-01
err0
PREAI
errJason N. Busby; Michael J. Landsberg; Robert M. Simpson; Sandra A. Jones; Ben Hankamer; Mark R.H. Hurst; J. Shaun Lott
err分享
err收藏
学者 查看更多内容