CLDiff: Weakly Supervised Cloud Detection With Denoising Diffusion Probabilistic Models

Yang Liu

doi:10.1109/TGRS.2024.3413892

Return

CLDiff: Weakly Supervised Cloud Detection With Denoising Diffusion Probabilistic Models

2024-01-01

PRE

DOI：10.1109/TGRS.2024.3413892

Original

Original request for help

Save

Abstract

En 中文

Cloud detection is an essential step in remote sensing (RS) image processing, contributing to various applications. However, existing fully supervised cloud detection methods rely on massive pixel-wise annotations, which are expensive and time-consuming. To alleviate the annotation burden, weakly supervised cloud detection (WSCD) has received extensive attention recently. One standard approach performs cloud detection within a classification paradigm, which inevitably faces category ambiguity when detecting semitransparent clouds. To tackle this problem, we propose a novel WSCD framework based on the diffusion model, termed CLDiff. Specifically, a multiscale feature rectification (MFR) module is introduced to extract multiscale semantic features in the encoder, enabling a definite identification of clouds and mitigating interference from bright objects in the background. Considering that clouds exhibit varying optical thicknesses, a diffusion decoder is developed to model the intraclass variations of clouds in a generative strategy, improving thin cloud detection. Initially, it devises a Gaussian modulation function to recalibrate ambiguous cloud activations and emphasize semitransparent clouds. Subsequently, these modulated activations serve as semantic guidance to optimize the diffusion process. This approach enables CLDiff to activate cloud contours under definite semantic conditions and avoids the additional branches for semantic learning as found in previous methods. Experimental results demonstrate that CLDiff achieves state-of-the-art performance in WSCD. A public reference implementation of this work in PyTorch is available at https://github.com/YLiu-creator/CLDiff.

Keywords:

Clouds

Semantics

Feature extraction

Annotations

Decoding

Remote sensing

Generative adversarial networks

Diffusion model

remote sensing (RS) image

semantic segmentation

weakly supervised cloud detection (WSCD)