arrow
Return

Diff-HRNet: A Diffusion Model-Based High-Resolution Network for Remote Sensing Semantic Segmentation

delete2025-01-01
delete0
PRE
AI
Z
Zhipeng Wu
C
Chang Liu
B
Bingze Song
H
Huaxin Pei
P
Pinjie Li
DOI:10.1109/LGRS.2024.3505552delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The semantic segmentation methods based on deep neural networks predominantly employ supervised learning, relying heavily on the quantity and quality of annotated samples. Due to the complexity of high-resolution remote sensing imagery, obtaining sufficient and precise pixel-level labeled data is highly challenging. This letter introduces a novel self-supervised learning method using a pretrained denoising diffusion probabilistic model (DDPM) to leverage semantic information from large-scale unlabeled remote sensing imageries. Building on this, a multistage fusion scheme between pretrained features and high-resolution features is proposed, enabling the network to learn more effective strategies to leverage prior information provided by the pretrained model while preserving the rich semantic details of high-resolution images. Experimental results on two remote sensing semantic segmentation datasets show that the proposed Diff-HRNet outperforms all compared methods, demonstrating the potential of pretrained diffusion models in extracting crucial feature representations for semantic segmentation tasks.
Keywords:
Feature extraction
Remote sensing
Semantics
Spatial resolution
Diffusion models
Noise reduction
Noise measurement
Convolution
Supervised learning
Denoising diffusion probabilistic model (DDPM)
self-supervised learning
semantic segmentation
semantic segmentation

Journal

IEEE Geoscience and Remote Sensing Magazine cover
IEEE Geoscience and Remote Sensing Magazine
IF:
16.4
Papers:
1.0W
Citations:
5.1K

Organization

No organization information available
Cited Papers

Cited Papers

On the Combination of Dual-Polarization Sentinel-1 Ascending/Descending Orbiting Passes to Estimate Damage Due to the 2016 Central Italy Earthquake
err2022-01-01
err0
errOAAI
errEmanuele Ferrentino; Ferdinando Nunziata; Christian Bignami; Laura Graziani; Alessandra Maramai; Maurizio Migliaccio; Salvatore Stramondo
errShare
errSave
A glove-based system for studying hand-object manipulation via joint pose and force sensing
err2017-09-01
err0
PREAI
errHangxin Liu; Xu Xie; Matt Millar; Mark Edmonds; Feng Gao; Yixin Zhu; Veronica J. Santos; Brandon Rothrock; Song-Chun Zhu
errShare
errSave
Structural Neural Substrates of Reading the Mind in the Eyes
err2016-04-11
err0
errOAAI
errWataru Sato; Takanori Kochiyama; Shota Uono; Reiko Sawada; Yasutaka Kubota; Sayaka Yoshimura; Motomi Toichi
errShare
errSave
errShare
errSave
Southeast Asian diversity: first insights into the complex mtDNA structure of Laos
err2011-02-18
err0
errOAAI
errMartin Bodner; Bettina Zimmermann; Alexander Röck; Anita Kloss-Brandstätter; David Horst; Basil Horst; Sourideth Sengchanh; Torpong Sanguansermsri; Jürgen Horst; Tanja Krämer; Peter M Schneider; Walther Parson
errShare
errSave
Renal Tubular Secretion of Tanshinol: Molecular Mechanisms, Impact on Its Systemic Exposure, and Propensity for Dose-Related Nephrotoxicity and for Renal Herb-Drug Interactions
err2015-05-01
err0
errOAAI
errWeiwei Jia; Feifei Du; Xinwei Liu; Rongrong Jiang; Fang Xu; Junling Yang; Li Li; Fengqing Wang; Olajide E Olaleye; Jiajia Dong; Chuan Li
errShare
errSave
Management of Multidirectional Instability
err1995-10-01
err0
PREAI
errKen Yamaguchi; Evan L. Flatow
errShare
errSave
researcher View more