arrow
Return

Spatio-Temporal Point Process for Multiple Object Tracking

delete2023-04-01
delete22
delete
OA
AI
T
Tao Wang
K
Kean Chen
林巍峣 (Weiyao Lin) *
J
John See
Z
Zenghui Zhang
Q
Qian Xu
X
Xia Jia
DOI:10.1109/TNNLS.2020.2997006delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Multiple object tracking (MOT) focuses on modeling the relationship of detected objects among consecutive frames and merge them into different trajectories. MOT remains a challenging task as noisy and confusing detection results often hinder the final performance. Furthermore, most existing research are focusing on improving detection algorithms and association strategies. As such, we propose a novel framework that can effectively predict and mask-out the noisy and confusing detection results before associating the objects into trajectories. In particular, we formulate such bad detection results as a sequence of events and adopt the spatio-temporal point process to model such events. Traditionally, the occurrence rate in a point process is characterized by an explicitly defined intensity function, which depends on the prior knowledge of some specific tasks. Thus, designing a proper model is expensive and time-consuming, with also limited ability to generalize well. To tackle this problem, we adopt the convolutional recurrent neural network (conv-RNN) to instantiate the point process, where its intensity function is automatically modeled by the training data. Furthermore, we show that our method captures both temporal and spatial evolution, which is essential in modeling events for MOT. Experimental results demonstrate notable improvements in addressing noisy and confusing detection results in MOT data sets. An improved state-of-the-art performance is achieved by incorporating our baseline MOT algorithm with the spatio-temporal point process model.
Keywords:
Noise measurement
Trajectory
Task analysis
Object tracking
Object detection
Time series analysis
Data models
Multiple object tracking
recurrent neural networks
spatio-temporal point processes
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.5K
Citations:
7.2W

Organization

S
shanghai jiao tong university
Scholars:
15.5W
Papers: 11.6W
Citations: 159
M
multimedia university
Scholars:
1.8K
Papers: 1.6K
Citations: 0
Z
zte
Scholars:
419
Papers: 412
Citations: 0
researcher View more organizations