arrow
Return

Exploiting Spatial-Temporal Dynamics for Satellite Image Sequence Prediction

delete2023-01-01
delete2
PRE
AI
K
Kuai Dai
C
Chi Ma
Z
Zhaolin Wang
Y
Yongshen Long
李旭涛 (Xutao Li) *
S
Shanshan Feng
Y
Yunming Ye
DOI:10.1109/LGRS.2023.3261317delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Satellite image sequence prediction is a challenging and significant task. The existing deep learning methods for the task make predictions mainly based on low-level pixelwise features, which fail to model the sophisticated spatial-temporal features of satellite image sequences and deliver unsatisfactory performance. In this letter, we present a hierarchical spatial-temporal network (HSTnet) for satellite image sequence prediction. With a carefully designed hierarchical feature extraction mechanism, HSTnet can learn effective spatial-temporal features from both pixel level and patch level. In addition, to better capture patch-level spatial-temporal dynamics, a dual-branch Transformer is proposed to model patch-level spatial and temporal features, respectively. Comprehensive experiments on the Fengyun-4A (FY-4A) satellite dataset demonstrate the superiority and effectiveness of our proposed method HSTnet over state-of-the-art approaches.
Keywords:
Satellites
Image sequences
Feature extraction
Transformers
Task analysis
Predictive models
Dynamics
Patch-level features
pixelwise features
satellite image sequence prediction
spatial-temporal features

Journal

IEEE Geoscience and Remote Sensing Magazine cover
IEEE Geoscience and Remote Sensing Magazine
IF:
16.4
Papers:
1.0W
Citations:
5.1K

Organization

H
harbin institute of technology
Scholars:
8.0W
Papers: 6.6W
Citations: 66