arrow
Return

STCD: efficient Siamese transformers-based change detection method for remote sensing images

delete2023-01-24
delete21
delete
OA
AI
D
Decheng Wang
X
Xiangning Chen *
N
Ningbo Guo
H
Hui Yi
Y
Yinan Li
DOI:10.1080/10095020.2022.2157762delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Remote sensing Change Detection (CD) involves identifying changing regions of interest in bi-temporal remote sensing images. CD technology has rapidly developed in recent years through the powerful learning ability of Convolutional Neural Networks (CNN), affording complex feature extraction. However, the local receptive fields in the CNN limit modeling long-range contextual relationships in semantic changes. Therefore, this work explores the great potential of Siamese Transformers in CD tasks and proposes a general CD model entitled STCD that relies on Swin Transformers. In the encoding process, pure Transformers without CNN are used to model the long-range context of semantic tokens, reducing computational overhead and improving model efficiency compared to current methods. During the decoding process, the 3D convolution block obtains the changing features in the time series and generates the predicted change map in the deconvolution layer with axial attention. Extensive experiments on three binary CD datasets and one semantic CD dataset demonstrate that the proposed STCD model outperforms several popular benchmark methods considering performance and the required parameters. Among the STCD variants, the F1-Score of the Base-STCD on the three binary CD datasets LEVIR, DSIFN, and SVCD reached 89.85%, 54.72%, and 93.75%, respectively, and the mF1-Score and mIoU on the semantic CD dataset SECOND were 75.60% and 66.19%.
Keywords:
Change detection (CD)
Siamese transformers
attention mechanism
semantic token
temporal feature fusion

Journal

G
Geo-Spatial Information Science
IF:
5.5
Papers:
838
Citations:
2.4K

Organization

S
Space Engineering University
Scholars:
1.0K
Papers: 674
Citations: 500