arrow
Return

Patchwise Temporal-Spatial Feature Aggregation Network for Object Detection in Satellite Video

delete2024-01-01
delete1
PRE
AI
S
Shangdong Zheng
Z
Zebin Wu *
杨旭 cover
杨旭 (Yang Xu)
P
Pengfei Liu
P
Peng Zheng
Z
Zhihui Wei
DOI:10.1109/LGRS.2024.3449127delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this letter, we propose a patchwise temporal-spatial feature aggregation (PTFA) network for object detection in satellite video. First, the feature extractor processes the key frame (KF) along with its support frames to ensure comprehensive spatial coverage of potential objects. Subsequently, we model the semantic similarities among instance-level proposals to exploring robust interaction between temporally adjacent support frames and KF. Furthermore, due to the extremely small size of objects in satellite video, we crop the input frames to different patches by the fixed criterion. Then, the temporal-spatial feature aggregation (TSFA) operations are performed on instance-level RoI features, which attains more nuanced and comprehensive descriptors from the explicit high-resolution temporal-spatial features. The patch features are reconstructed to the original one for complementing more valid feature responses. Finally, we compare our PTFA network with many recent works on the SAT-MTB dataset. Extensive experiments demonstrate that our method achieves the state-of-the-art performance than various static image and video object detection (VID) approaches.
Keywords:
Object detection
patchwise
satellite video
temporal-spatial feature aggregation (TSFA)
patchwise
satellite video
temporal-spatial feature aggregation (TSFA)

Journal

IEEE Geoscience and Remote Sensing Magazine cover
IEEE Geoscience and Remote Sensing Magazine
IF:
16.4
Papers:
1.0W
Citations:
5.1K

Organization

No organization information available