Prototype-Driven Structure Synergy Network for Remote Sensing Images Segmentation

Junyi Wang

doi:10.1109/TGRS.2025.3622574

Prototype-Driven Structure Synergy Network for Remote Sensing Images Segmentation

2025-01-01

0

PRE

AI

DOI：10.1109/TGRS.2025.3622574

Original

Original request for help

Save

Abstract

En 中文

In the semantic segmentation of remote sensing images, acquiring complete ground objects is critical for achieving precise analysis. However, this task is severely hindered by two major challenges: high intra-class variance and high inter-class similarity. Traditional methods often yield incomplete segmentation results due to their inability to effectively unify class representations and distinguish between similar features. Even emerging class-guided approaches are limited by coarse class prototype representations and a neglect of target structural information. Therefore, this article proposes a prototype-driven structure synergy network (PDSSNet). The design of this network is based on a core concept: a complete ground object is jointly defined by its invariant class semantics and its variant spatial structure. To implement this, we have designed three key modules. First, the adaptive prototype extraction module (APEM) ensures semantic accuracy from the source by encoding the ground truth to extract comprehensive class prototypes. Subsequently, the designed semantic-structure coordination module (SSCM) follows a hierarchical “semantics-first, structure-second” principle. This involves first establishing a global semantic cognition, then leveraging structural information to constrain and refine the semantic representation, thereby ensuring the integrity of class information. Finally, the channel similarity adjustment module (CSAM) employs a dynamic step-size adjustment mechanism to focus on discriminative features between classes. Extensive experiments demonstrate that PDSSNet outperforms state-of-the-art methods. The source code is available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/wangjunyi-1/PDSSNet</uri>

Keywords:

Mamba

prototype drive

semantic segmentation

state-space model (SSM)

Prototype-Driven Structure Synergy Network for Remote Sensing Images Segmentation

Abstract

Journal

Organization