.png){kind=icon}
返回
A Creative Weak Supervised Semantic Segmentation for Remote Sensing Images
.png){kind=icon}
OA
AI
DOI：10.1109/TGRS.2024.3477749.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In weakly supervised semantic segmentation (WSSS) tasks on remote sensing images, it is a common practice to train a classification network from scratch using a large batch of images with a limited number of classes. Subsequently, class activation maps are extracted from the model based on predefined class indices, and these maps are then optimized to obtain pseudolabels. To make this strategy effective when introducing a new class, a substantial amount of data needs to be provided to the model. In this article, we present an innovative framework, RS-TextWS-Seg, designed to efficiently generate high-quality segmentation results for a wide range of remote sensing objects using concise descriptions. Our proposed framework comprises three sequential stages: initially, we undertake parameter fine-tuning of the contrastive language-image pretraining (CLIP) model to swiftly strengthen its capacity for zero-shot detection of a limited number of remote sensing features. Subsequently, we introduce a text-driven background suppression mechanism aimed at deriving class activation maps from the refined CLIP model based on textual cues, while concurrently mitigating background noises. Finally, we use the segment anything model (SAM) to refine the edges of the extracted class activation map. We widely researched the leading-edge methodologies in WSSS and conducted a range of comparative experiments and ablation studies to prove the efficacy of our proposed framework. The research findings underscore that RS-TextWS-Seg outperforms other state-of-the-art methods on renowned datasets such as DLRSD and Potsdam, as well as on bespoke datasets specifically curated for overground petroleum pipelines and oil well fields.
Keyword:
Remote sensing
Semantic segmentation
Cams
Training
Feature extraction
Sensors
Semantics
Petroleum
Location awareness
Decoding
Fine-tuning
remote sensing image
text prompts
weakly supervised semantic segmentation (WSSS)
期刊
IF:
8.6
论文数:
2.2W
被引数:
10.7W
机构
引用论文
PANet: Pixelwise Affinity Network for Weakly Supervised Building Extraction From High-Resolution Remote Sensing ImagesPANet: 用于从高分辨率遥感图像中提取弱监督建筑物的Pixelwise亲和网络
PREAI
分享收藏Hierarchical Weakly Supervised Learning for Residential Area Semantic Segmentation in Remote Sensing Images基于分层弱监督学习的遥感影像居民区语义分割
PREAI
分享收藏
分享收藏Enchytraeidae Fridericia bulbosa as a new test species for soil ecotoxicity assessment.png)
Chemosphere
ChemosphereIF0
PREAI
分享收藏
查看更多内容