.png){kind=icon}
返回
Generic Knowledge Boosted Pretraining for Remote Sensing Images
.png){kind=icon}
OA
AI
DOI：10.1109/TGRS.2024.3354031.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Deep learning models are essential for scene classification, change detection, land cover segmentation, and other remote sensing (RS) image understanding tasks. Most backbones of existing RS deep learning models are typically initialized by pretrained weights obtained from ImageNet pretraining (IMP). However, domain gaps exist between RS images and natural images (e.g., ImageNet), making deep learning models initialized by pretrained weights of IMP perform poorly for RS image understanding. Although some pretraining methods are studied in the RS community, current RS pretraining (RSP) methods face the problem of vague generalization by only using RS images. In this article, we propose a novel RSP framework, generic knowledge boosted RSP (GeRSP), to learn robust representations from RS and natural images for RS understanding tasks. GeRSP contains two pretraining branches: 1) a self-supervised pretraining branch is adopted to learn domain-related representations from unlabeled RS images and 2) a supervised pretraining branch is integrated into GeRSP for general knowledge learning from labeled natural images. Moreover, GeRSP combines two pretraining branches using a teacher-student architecture to simultaneously learn representations with general and special knowledge, which generates a powerful pretrained model for deep learning model initialization. Finally, we evaluate GeRSP and other RSP methods on three downstream tasks, i.e., object detection, semantic segmentation, and scene classification. The extensive experimental results consistently demonstrate that GeRSP can effectively learn robust representations in a unified manner, improving the performance of RS downstream tasks. Code and pretrained models: https://github.com/floatingstarZ/GeRSP.
Keyword:
Pretraining
remote sensing (RS) image
self-supervised learning
期刊
IF:
8.6
论文数:
2.2W
被引数:
10.7W
机构
引用论文
.png){kind=icon}
Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍？
PREAI
分享收藏Semantic Segmentation of Remote Sensing Images With Self-Supervised Semantic-Aware Inpainting基于自监督语义感知的遥感图像语义分割
PREAI
分享收藏Boundary Enhancement Semantic Segmentation for Building Extraction From Remote Sensed Image基于边界增强语义分割的遥感影像建筑物提取
PREAI
分享收藏Object detection in optical remote sensing images: A survey and a new benchmark光学遥感图像中的目标检测: 调查和新基准
OAAI
OAAI分享收藏分享收藏分享收藏
查看更多内容