.png){kind=icon}
返回
Intertemporal Interaction and Symmetric Difference Learning for Remote Sensing Image Change Captioning
.png){kind=icon}
PRE
AI
DOI：10.1109/TGRS.2024.3462091.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Remote sensing image change captioning (RSICC) is more challenging than remote sensing change detection task, which requires extracting occurred changes in similar remote sensing image (RSI) pairs while generating change caption. However, few works have been investigated on RSICC, the main challenges come from how to learn abundant change clues and face the modality gap. To handle these problems, we rethink this task from the perspective of obtaining and aligning symmetrical change features for temporal RSIs. In this work, the proposed intertemporal interaction and symmetric difference learning network are cascaded through several multitemporal integration units to model differences from coarse to fine representations. Specifically, we design a cross-temporal attention (CTA) mechanism to probe direct interaction between bi-temporal RSIs for motivating information coupling between intralevel representations and suppressing irrelevant interferences. To learn robust change features, a symmetric difference transformer (SDT) module is devised to guarantee temporal symmetry between the before-to-after and after-to-before change representations. Besides, the bi-directional triplet ranking loss is adopted to guide the network to learn strongly discriminative and temporal-symmetric change representation. Extensive experimental results on Dubai-CC and LEVIR-CC datasets demonstrate that our framework with the proposed components can achieve excellent performance and surpass recent state-of-the-art methods. https://github.com/romanticLYP/TISDNet
Keyword:
Transformers
Feature extraction
Semantics
Remote sensing
Decoding
Visualization
Sensors
Cross-temporal attention (CTA)
remote sensing change captioning
symmetric change detection
temporal remote sensing images (RSIs)
期刊
IF:
8.6
论文数:
2.2W
被引数:
10.7W
机构
引用论文
.png){kind=icon}
分享收藏Monte-Carlo simulations of spinodal ordering and decomposition in compositionally modulated alloys
PREAI
分享收藏
分享收藏
分享收藏Forest Change Detection in Incomplete Satellite Images With Deep Neural Networks基于深度神经网络的不完整卫星影像森林变化检测
PREAI
分享收藏分享收藏分享收藏
查看更多内容