.png){kind=icon}
返回
Remote Sensing Image Change Detection With Transformers
.png){kind=icon}
OA
AI
DOI：10.1109/TGRS.2021.3095166.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Modern change detection (CD) has achieved remarkable success by the powerful discriminative ability of deep convolutions. However, high-resolution remote sensing CD remains challenging due to the complexity of objects in the scene. Objects with the same semantic concept may show distinct spectral characteristics at different times and spatial locations. Most recent CD pipelines using pure convolutions are still struggling to relate long-range concepts in space-time. Nonlocal self-attention approaches show promising performance via modeling dense relationships among pixels, yet are computationally inefficient. Here, we propose a bitemporal image transformer (BIT) to efficiently and effectively model contexts within the spatial-temporal domain. Our intuition is that the high-level concepts of the change of interest can be represented by a few visual words, that is, semantic tokens. To achieve this, we express the bitemporal image into a few tokens and use a transformer encoder to model contexts in the compact token-based space-time. The learned context-rich tokens are then fed back to the pixel-space for refining the original features via a transformer decoder. We incorporate BIT in a deep feature differencing-based CD framework. Extensive experiments on three CD datasets demonstrate the effectiveness and efficiency of the proposed method. Notably, our BIT-based model significantly outperforms the purely convolutional baseline using only three times lower computational costs and model parameters. Based on a naive backbone (ResNet18) without sophisticated structures (e.g., feature pyramid network (FPN) and UNet), our model surpasses several state-of-the-art CD methods, including better than four recent attention-based methods in terms of efficiency and accuracy. Our code is available at https://github.com/justchenhao/BIT_CD.
Keyword:
Semantics
Context modeling
Feature extraction
Computational modeling
Task analysis
Buildings
Radio frequency
Attention mechanism
change detection (CD)
convolutional neural networks (CNNs)
high-resolution (HR) optical remote sensing (RS) image
transformers
期刊
IF:
8.6
论文数:
2.2W
被引数:
10.7W
机构
引用论文
.png){kind=icon}
分享收藏
Change Detection Based on Deep Siamese Convolutional Network for Optical Aerial Images基于深度暹罗卷积网络的光学航空影像变化检测
PREAI
分享收藏SNUNet-CD: A Densely Connected Siamese Network for Change Detection of VHR ImagesSnunet-cd: 一个用于VHR图像变化检测的密集连体网络
PREAI
分享收藏
查看更多内容