arrow
返回

High-Order Semantic Decoupling Network for Remote Sensing Image Semantic Segmentation

delete2023-01-01
delete18
PRE
AI
C
Chengyu Zheng
J
Jie Nie *
Z
Zhaoxin Wang
N
Ning Song
J
Jingyu Wang
Z
Zhiqiang Wei
DOI:10.1109/TGRS.2023.3249230delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Low-order features based on convolution kernel are easy to be distorted when encountering dramatic view angle transformation and atmospheric scattering in remote sensing (RS) images. To address this concern, this article first proposes to operate semantic segmentation of RS images based on the high-order information, which can represent the relative relationship of low-order features and is robust and stable when suffering feature distortion. Besides, semantic decouples have recently been well researched and have achieved significant improvement in image understanding. Thus, in this article, a high-order semantic decoupling network (HSDN) is proposed to disentangle features by semantics based on high-order features. Specifically, HSDN first represents each pixel by calculating the pixel-level affinity as a high-order feature and then clusters these pixels into different semantics. Afterward, an attention-like mask generation module is designed for both intra-semantic and inter-semantic groups, leading to three kinds of masks, including the semantic decoupling mask (SDM), which utilizes each high-order cluster centroid as a mask to compact features intracluster and expand different interclusters, so as to improve semantic disentangle performance to a better extent; semantic enhancement mask (SEM), which records pixel-level relative correlation within a class to sufficiently exploit high-order features and could enhance feature robustness; and boundary supplementary mask (BSM), which aims to process borderline pixels to reduce cluster errors. Finally, by applying masks on pixels both within classes and on borderlines, semantic decoupled features are generated and concatenated to realize segmentation. The quantitative and qualitative experiments are conducted on two large-scale fine-resolution RS image datasets to demonstrate the significant performance of adopting high-order representation. Besides, we also implement numerous experiments to validate the effectiveness of the proposed semantic decouple framework in dealing with complicated and distortion-prone RS image segmentation tasks.
Keyword:
Semantics
Remote sensing
Semantic segmentation
Feature extraction
Scattering
Convolution
Task analysis
High-order representation (HR)
remote sensing (RS)
semantic decoupling
semantic segmentation

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.2W
被引数:
10.7W

机构

O
ocean university of china
学者数:
3.1W
论文数: 2.0W
被引数: 21
引用论文

引用论文

Proximal Femoral Fractures Following Total Hip Arthroplasty
err1982-10-01
err0
PREAI
errJ. STEPHEN BETHEA; J. ROBIN DEANDRADE; LAMAR L. FLEMING; STEPHEN D. LINDENBAUM; RICHARD B. WELCH
err分享
err收藏
A Pilot Study of the Efficacy of the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders in Treating Posttraumatic Psychopathology: A Randomized Controlled Trial
err2021-01-16
err0
errOAAI
errMeaghan L. O'Donnell; Winnie Lau; Katherine Chisholm; James Agathos; Jonathon Little; Sonia Terhaag; Rachel Brand; Andrea Putica; Alexander C. N. Holmes; Lynda Katona; Kim L. Felmingham; Kim Murray; Fardous Hosseiny; Matthew W. Gallagher
err分享
err收藏
Electrochemically assisted micro localized grafting of aptamers in a microchannel engraved in fluorinated thermoplastic polymer Dyneon THV
err2015-01-01
err0
PREAI
errC. Perréard; Y. Ladner; F. d'Orlyé; S. Descroix; V. Taniga; A. Varenne; F. Kanoufi; C. Slim; S. Griveau; F. Bedioui
err分享
err收藏
err分享
err收藏
The Separation of Recombinant Human Growth Hormone Variants by UHPLC
err2012-12-04
err0
errOAAI
errGöran Karlsson; Kathryn Eriksson; Annevi Persson; Håkan Månsson; Susanne Söderholm
err分享
err收藏
A biomechanical assessment of modular and monoblock revision hip implants using FE analysis and strain gage measurements
err2010-05-12
err0
errOAAI
errHabiba Bougherara; Rad Zdero; Suraj Shah; Milan Miric; Marcello Papini; Paul Zalzal; Emil H Schemitsch
err分享
err收藏
Modelling the accumulation of hydrophobic organic chemicals in earthworms模拟蚯蚓中疏水性有机化学物质的积累
err1995-07-01
err0
PREAI
errAngélique C. Belfroid; Willem Scinen; Kees C. A. M. van Gestel; Joop L. M. Hermens; Kees J. van Leeuwen
err分享
err收藏
学者 查看更多内容