arrow
Return

A communication-efficient distributed deep learning remote sensing image change detection framework

delete2024-05-01
delete1
delete
OA
AI
H
Hongquan Cheng
J
Jie Zheng
H
Huayi Wu *
祁昆仑 (Kunlun Qi)
DOI:10.1016/j.jag.2024.103840delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
With the introduction of deep learning methods, the computation required for remote sensing change detection has significantly increased, and distributed computing is applied to remote sensing change detection to improve computational efficiency. However, due to the large size of deep learning models, the time-consuming gradient transfer during distributed model training weakens the acceleration effectiveness in change detection. Data communication and updates can be the bottlenecks in distributed change detection systems with limited network resources. To address the interrelated problems, we propose a communication -efficient distributed deep learning remote sensing change detection framework (CEDD-CD) based on the synchronous update architecture. The CEDD-CD integrates change detection with communication -efficient distributed gradient compression approaches, which can efficiently reduce the data volume to be transferred. In addition, for the implicit effect caused by the delay of compressed gradient update, a momentum compensation mechanism under theoretical analysis was constructed to reduce the time consumption required for model convergence and strengthen the stability of distributed training. We also designed a unified distributed change detection system architecture to reduce the complexity of distributed modeling. Experiments were conducted on three datasets; the qualitative and quantitative results demonstrate that the CEDD-CD was effective for massive remote sensing image change detection.
Keywords:
Change detection
Distributed deep learning
Parallel computing
Communication compression
Staleness compensation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

International Journal of Applied Earth Observation and Geoinformation cover
International Journal of Applied Earth Observation and Geoinformation
IF:
8.6
Papers:
5.1K
Citations:
2.4W

Organization

C
China University of Geosciences
Scholars:
3.7W
Papers: 2.8W
Citations: 4.3W
G
guangdong university of technology
Scholars:
2.9W
Papers: 2.0W
Citations: 36