.png){kind=icon}
.png){kind=icon}
Return
ATSG: Adaptive Token Linking With Segment Anything Model Guidance for Weakly Supervised Remote Sensing Image Semantic Segmentation
.png){kind=icon}
PRE
AI
DOI：10.1109/TGRS.2026.3653675.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Semantic segmentation of remote sensing images is vital for applications such as urban planning and disaster monitoring. However, the high cost of pixel-level annotations often results in limited labeled data, necessitating weakly supervised learning approaches. Unlike natural images, remote sensing images typically contain numerous small objects with substantial intraclass variations and high interclass similarities, which pose challenges for generating high-quality pseudolabel. In addition, while vision transformers (ViTs) have been integrated into weakly supervised semantic segmentation (WSSS) for their global modeling capabilities, they are prone to oversmoothing in dense scenes, which impedes model learning. To address these challenges, we propose two novel modules: the adaptive token linking (Adalink) module and the segment anything model (SAM)-guided boundary refiner (SGBR) module. First, Adalink employs a dynamic aggregation mechanism to analyze semantic diversity across the middle layer of ViT, adaptively selecting the feature layer and constructing token correlation graphs. It leverages a self-supervised encoder to extract hierarchical token relationships and to supervise pseudolabel generation, thereby reducing erroneous activations in cluttered scenes and improving pseudolabel quality. Second, SGBR utilizes the zero-shot segmentation capability of the SAM to refine segmentation results by incorporating object and boundary priors from the output images, significantly enhancing the completeness of small object segmentation and overall accuracy. Extensive experiments on the ISPRS Potsdam, ISPRS Vaihingen, and iSAID datasets demonstrate that our method achieves state-of-the-art (SOTA) performance and exhibits strong practical value in processing complex remote sensing scenes. Code will be available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/zhangyifan25/ATSG</uri>
Keywords:
Remote sensing images
segment anything model (SAM)
weakly supervised semantic segmentation (WSSS)
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
8.6
Papers:
2.1W
Citations:
10.7W