arrow
返回

Cross-Difference Semantic Consistency Network for Semantic Change Detection

delete2024-01-01
delete6
PRE
AI
王
王琦 (Qi Wang) *
W
Wei Jing
K
Kaichen Chi
Y
Yuan Yuan
DOI:10.1109/TGRS.2024.3386334delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The objective of semantic change detection (SCD) is to discern intricate changes in land cover while simultaneously identifying their semantic categories. Prior research has shown that using multiple independent branches for the distinct tasks of change localization and semantic recognition is a reliable approach to solving the SCD problem. Nevertheless, conventional SCD architectures rely heavily on a high degree of consistency within the bitemporal feature space when modeling difference features, inevitably resulting in false positives or missed alerts within change areas. In this article, we introduce an SCD framework called the cross-differential semantic consistency network. Cross-difference semantic consistency (CdSC) is designed to mine deep discrepancies in bitemporal instance features while preserving their semantic consistency. Specifically, the 3-D cross-difference module, incorporating 3-D convolutions, explores the interaction of cross-temporal features, revealing inherent differences among various land features. Simultaneously, deep semantic representations are further utilized to enhance the local correlation of difference information, thereby improving the model's discriminative capabilities within change regions. Incorporating principles from contrastive learning, a semantic co-alignment (SCA) loss is introduced to increase intra-class consistency and inter-class distinctiveness of dual-temporal semantic features, thereby addressing the challenges posed by semantic disparities. Extensive experiments on two SCD datasets demonstrate that CdSC outperforms other state-of-the-art SCD methods significantly in both qualitative and quantitative evaluations. The code and dataset are available at https://github.com/weiAI1996/CdSC.
Keyword:
Semantics
Feature extraction
Task analysis
Self-supervised learning
Data models
Data mining
Solid modeling
Cross-difference
deep learning
remote sensing image
semantic change detection (SCD)
semantic consistency

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.2W
被引数:
10.7W

机构

N
Northwestern Polytechnical University
学者数:
4.6W
论文数: 3.7W
被引数: 5.3W
引用论文

引用论文

Estudo eletroquímico da recuperação de metais de pilhas e de baterias descartadas após o uso
err2012-09-01
err0
errOAAI
errKellie Provazi; Denise Crocce Romano Espinosa; Jorge Alberto Soares Tenório
err分享
err收藏
ALTERATION OF TELOMERIC REPEAT LENGTH IN ADULT AND CHILDHOOD SOLID NEOPLASIAS
err1995-01-01
err0
PREAI
errE HIYAMA; T YOKOHAMA; K HIYAMA; M YAMAKIDO; T SANTO; T KODAMA; T ICHIKAWA; Y MATSUURA
err分享
err收藏
学者 查看更多内容