.png){kind=icon}
Return
Joint spatio-temporal modeling for visual tracking
.png){kind=icon}
PRE
AI
DOI：10.1016/j.knosys.2023.111206.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Similarity-based approaches have made significant progress in visual object tracking (VOT). Although these methods work well in simple scenes, they ignore the continuous spatio-temporal connection of the object in the video sequence. For this reason, tracking by spatial matching solely can lead to tracking failures because of distractors and occlusion. In this paper, we propose a spatio-temporal joint-modeling tracker named STTrack which implicitly builds continuous connections between the temporal and spatial aspects of the sequence. Specifically, we first design a time-sequence iteration strategy (TSIS) to concentrate on the temporal connection of the object in the video sequence. Then, we propose a novel spatial temporal interaction Transformer network (STIN) to capture the spatio-temporal correlation of the object between frames. The proposed STIN module is robust in object occlusion because it explores the dynamic state change dependencies of the object. Finally, we introduce a spatio-temporal query to suppress distractors by iteratively propagating the target prior. Extensive experiments on six tracking benchmark datasets demonstrate that the proposed STTrack achieves excellent performance while operating in real-time. The code is publicly available at https://github.com/nubsym/STTrack.
Keywords:
Visual tracking
Siamese trackers
Sequence prediction
Spatio-temporal model
Journal
K
IF:
7.6
Papers:
1.3W
Citations:
4.5W
Organization
Cited Papers
Predator-Prey Dynamics Driven by Feedback between Functionally Diverse Trophic Levels.png)
PLoS ONE
OAAI
PLoS ONEIF0
OAAIShareSaveSustaining the efficiency of the Fe(0)/H2O system for Cr(VI) removal by MnO2 amendmentChemosphere
ChemosphereIF0
PREAI
ShareSaveOptimal design of a manufacturing-remanufacturing-transport system within a reverse logistics chain
PREAI
ShareSaveA novel flake-ball-like magnetic Fe3O4/γ-MnO2 meso-porous nano-composite: Adsorption of fluorinion and effect of water chemistryChemosphere
ChemosphereIF0
PREAI
ShareSaveYoung age and tobacco use are predictors of lower medication adherence in inflammatory bowel disease
PREAI
ShareSaveGeriatric Assessments and Medication Therapy Management Approaches in Elderly Oncology Patients
PREAI
ShareSaveFTIR spectroscopy of whole cells for the monitoring of yeast apoptosis mediated by p53 over-expression and its suppression by Nigella sativa extractsPLOS ONE
OAAI
PLOS ONEIF0
OAAIShareSave
View more