arrow
返回

SDC-GAE: Structural Difference Compensation Graph Autoencoder for Unsupervised Multimodal Change Detection

delete2024-01-01
delete5
PRE
AI
T
Te Han
汤玉奇 (Yuqi Tang) *
Y
Yuzeng Chen
杨鑫 封面图
杨鑫 (Xin Yang)
Y
Yuqiang Guo
S
Shujing Jiang
DOI:10.1109/TGRS.2024.3396141delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multimodal change detection (MCD) is a crucial technology for applications in natural resource monitoring, disaster assessment, and urban planning. To address the reliance on labeled data and enhance the robustness of structural features in the existing methods, we propose a structure difference compensation graph autoencoder (SDC-GAE) for unsupervised MCD. It is recognized that the registered multimodal images exhibit consistency in structural features in unchanged areas, while the structural features in changed areas are distinct. SDC-GAE utilizes a graph convolutional network (GCN) to extract deep structural features from multimodal images. It uses the structural features of one time-phase image to reconstruct its spectral features in the spectral feature space of the target image. Through structural difference compensation, SDC-GAE learns the structural disparities between different images, with the compensation value directly reflecting the intensity of the changes. The SDC-GAE loss function consists of three components: image reconstruction loss, which evaluates the spectral feature discrepancy between the reconstructed and target images, guiding the model to reduce these differences via structural difference compensation; sparse constraint loss, which accounts for the fact that changes are typically confined to a few areas, ensuring the sparsity of the detected changes; and structural consistency loss, which aligns the structural features of the reconstructed image closely with those of the target image. The efficacy of our method is validated through experiments on eight multimodal datasets, where it is compared with the state-of-the-art methods.
Keyword:
Remote sensing
Feature extraction
Imaging
Adaptation models
Satellite broadcasting
Robustness
Monitoring
Compensation
graph convolutional network (GCN)
multimodal change detection (MCD)
multisource data
structural difference
structural feature
structured graph

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.1W
被引数:
10.7W

机构

C
Central South University
学者数:
10.0W
论文数: 7.2W
被引数: 10.9W
W
wuhan university
学者数:
8.1W
论文数: 5.8W
被引数: 70
引用论文

引用论文

Refining a kick sampling strategy for the bioassessment of benthic macroinvertebrates in headwater streams
err2011-11-03
err0
PREAI
errHugh B. Feeley; Martina Woods; Jan-Robert Baars; Mary Kelly-Quinn
err分享
err收藏
Deep Image Translation With an Affinity-Based Change Prior for Unsupervised Multimodal Change Detection
err2022-01-01
err80
errOAAI
errLuppino, Luigi Tommaso; Kampffmeyer, Michael; Bianchi, Filippo Maria; Moser, Gabriele; Serpico, Sebastiano Bruno; Jenssen, Robert; Anfinsen, Stian Normann
err分享
err收藏
Deep learning for change detection in remote sensing: a review深度学习在遥感变化检测中的应用综述
err2022-07-01
err124
errOAAI
errBai, Ting; Wang, Le; Yin, Dameng; Sun, Kaimin; Chen, Yepei; Li, Wenzhuo; Li, Deren
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容