arrow
返回

STAT: Multi-Object Tracking Based on Spatio-Temporal Topological Constraints

delete2024-01-01
delete4
PRE
AI
J
Junjie Zhang
M
Mingyan Wang
H
Haoran Jiang
X
Xinyu Zhang
C
Chenggang Yan
D
Dan Zeng *
DOI:10.1109/TMM.2023.3323852delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The mainstream tracking-by-detection paradigm for multi-object tracking generally conducts detection first, followed by Re-IDentification (Re-ID) and motion estimation. The associations between the predicted boxes and existing tracks are then performed via visual and motion association. However, challenges such as irregular motion patterns, similar appearances, and frequent occlusions often arise, making object tracking a nontrivial task. In this article, we propose a multi-object tracker based on Spatio-TemporAl Topological (STAT) constraints to address the above issues. More specifically, we design the Feature Adaptive Association Module (FAAM) to establish the association between motion and appearance regionally, completing a complementary combination of appearance and motion features. Among these, the Appearance Feature Update Module (AFUM) is proposed to manage the appearance updates of tracked objects by imposing constraints based on the spatial locations and the degree of object occlusion, while temporal consistency is adopted to smooth the appearance states of tracks to mitigate the accumulation of appearance noise. Moreover, the Robust Motion Tracking Module (RMTM) is established to reduce the impact of irregular motions and certain unreliable detection results. The proposed module includes a higher weighted momentum term to accommodate the excessive motion amplitude and considers low-confidence boxes accompanied by the stage-wise association strategy for high-confidence boxes. Extensive experiments on DanceTrack and benchmark MOT datasets verify the effectiveness of our STAT tracker, especially the state-of-the-art results on DanceTrack, which is characterized by irregular motion and indistinguishable appearance attributes.
Keyword:
Tracking
Feature extraction
Adaptation models
Benchmark testing
Visualization
Topology
Symbols
Multi-object tracking
adaptive association
spatio-temporal topology

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.5K
被引数:
2.4W

机构

U
University of Adelaide
学者数:
2.3W
论文数: 2.4W
被引数: 4.2W
H
Hangzhou Dianzi University
学者数:
1.3W
论文数: 9.6K
被引数: 7.5K
S
shanghai university
学者数:
3.9W
论文数: 2.7W
被引数: 52
学者 查看更多机构
引用论文

引用论文

Metagenomic assessment of adventitious viruses in commercial bovine sera
err2017-05-01
err0
PREAI
errKathy Toohey-Kurth; Samuel D. Sibley; Tony L. Goldberg
err分享
err收藏
err分享
err收藏
The Wills Eye Glaucoma App: Interest of Patients and Their Caregivers in a Smartphone-based and Tablet-based Glaucoma Application
err2016-09-01
err0
PREAI
errMichael Waisbourd; Hermandeep Dhami; Chen Zhou; Michael Hsieh; Pramod Abichandani; Michael J. Pro; Marlene R. Moster; L. Jay Katz; Lisa A. Hark; Jonathan S. Myers
err分享
err收藏
A Procedure for Scaling Perceptions of Lodging Quality
err2018-04-24
err0
PREAI
errJuliet M. Getty; Kenneth N. Thompson
err分享
err收藏
New extension of the Kalman filter to nonlinear systems
err1997-07-28
err0
PREAI
errSimon J. Julier; Jeffrey K. Uhlmann
err分享
err收藏
Rethinking the Competition Between Detection and ReID in Multiobject Tracking
err2022-01-01
err145
errOAAI
errLiang, Chao; Zhang, Zhipeng; Zhou, Xue; Li, Bing; Zhu, Shuyuan; Hu, Weiming
err分享
err收藏
An NFC Approach for Nursing Care Training
err2011-02-01
err0
PREAI
errJesus Fontecha; Ramon Hervas; Jose Bravo; Vladimir Villarreal
err分享
err收藏
学者 查看更多内容