.png){kind=icon}
返回
CLDiff: Weakly Supervised Cloud Detection With Denoising Diffusion Probabilistic Models
.png){kind=icon}
PRE
AI
DOI：10.1109/TGRS.2024.3413892.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Cloud detection is an essential step in remote sensing (RS) image processing, contributing to various applications. However, existing fully supervised cloud detection methods rely on massive pixel-wise annotations, which are expensive and time-consuming. To alleviate the annotation burden, weakly supervised cloud detection (WSCD) has received extensive attention recently. One standard approach performs cloud detection within a classification paradigm, which inevitably faces category ambiguity when detecting semitransparent clouds. To tackle this problem, we propose a novel WSCD framework based on the diffusion model, termed CLDiff. Specifically, a multiscale feature rectification (MFR) module is introduced to extract multiscale semantic features in the encoder, enabling a definite identification of clouds and mitigating interference from bright objects in the background. Considering that clouds exhibit varying optical thicknesses, a diffusion decoder is developed to model the intraclass variations of clouds in a generative strategy, improving thin cloud detection. Initially, it devises a Gaussian modulation function to recalibrate ambiguous cloud activations and emphasize semitransparent clouds. Subsequently, these modulated activations serve as semantic guidance to optimize the diffusion process. This approach enables CLDiff to activate cloud contours under definite semantic conditions and avoids the additional branches for semantic learning as found in previous methods. Experimental results demonstrate that CLDiff achieves state-of-the-art performance in WSCD. A public reference implementation of this work in PyTorch is available at https://github.com/YLiu-creator/CLDiff.
Keyword:
Clouds
Semantics
Feature extraction
Annotations
Decoding
Remote sensing
Generative adversarial networks
Diffusion model
remote sensing (RS) image
semantic segmentation
weakly supervised cloud detection (WSCD)
期刊
IF:
8.6
论文数:
2.2W
被引数:
10.7W
机构
引用论文
Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍？
.png){kind=icon}
PREAI
分享收藏
分享收藏
Graph Information Aggregation Cross-Domain Few-Shot Learning for Hyperspectral Image Classification
PREAI
分享收藏分享收藏
查看更多内容