arrow
Return

Engineering an efficient object tracker for nonlinear motion

delete2025-12-13
delete0
PRE
AI
M
Momir Adžemović *
P
Predrag Tadić
A
Andrija Petrović
M
Mladen Nikolić
DOI:10.1007/s00371-025-04243-7delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
The goal of multi-object tracking is to detect and track all objects in a scene while maintaining unique identifiers for each, by associating their bounding boxes across video frames. This association relies on matching motion and appearance patterns of detected objects. This task is especially hard in scenarios involving dynamic and nonlinear motion patterns. In this paper, we introduce a novel, carefully engineered multi-object tracker designed specifically for such scenarios. In addition to standard methods of appearance-based association, we improve motion-based association by employing deep learnable filters (instead of the most commonly used Kalman filter) and a rich set of newly proposed heuristics. Our improvements to motion-based association methods are severalfold. First, we propose a new transformer-based filter architecture which uses an object’s motion history for both motion prediction and noise filtering. We further enhance the filter’s performance by careful handling of its motion history and accounting for camera motion. Second, we propose a set of heuristics that exploit cues from the position, shape, and confidence of detected bounding boxes to improve association performance. Our experimental evaluation demonstrates that our proposed tracker outperforms existing methods in scenarios featuring nonlinear motion, surpassing state-of-the-art results on three such datasets. We also perform a thorough ablation study to evaluate the contributions of different tracker components which we proposed. Based on our study, we conclude that using a learnable filter instead of the Kalman filter, along with appearance-based association is key to achieving strong general tracking performance.
Keywords:
Filter
Motion model
Deep learning
Multi-object tracking
Transformer

Journal

T
The Visual Computer
IF:
0
Papers:
369
Citations:
0

Organization

F
faculty of organizational sciences
Scholars:
11
Papers: 12
Citations: 0
F
Faculty of Mathematics
Scholars:
171
Papers: 82
Citations: 1
S
School of Electrical Engineering
Scholars:
537
Papers: 243
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

Hybrid-SORT: Weak Cues Matter for Online Multi-Object Tracking
err2024-03-24
err0
errOAAI
errMingzhan Yang; Guangxin Han; Bin Yan; Wenhua Zhang; Jinqing Qi; Huchuan Lu; Dong Wang
errShare
errSave
SoccerNet-Tracking: Multiple Object Tracking Dataset and Benchmark in Soccer Videos
err2022-06-01
err0
errOAAI
errAnthony Cioppa; Silvio Giancola; Adrien Deliege; Le Kang; Xin Zhou; Zhiyu Cheng; Bernard Ghanem; Marc Van Droogenbroeck
errShare
errSave
errShare
errSave
Onboard Dynamic-Object Detection and Tracking for Autonomous Robot Navigation With RGB-D Camera
err2024-01-01
err0
errOAAI
errZhefan Xu; Xiaoyang Zhan; Yumeng Xiu; Christopher Suzuki; Kenji Shimada
errShare
errSave
TrackFormer: Multi-Object Tracking with Transformers
err2022-06-01
err0
errOAAI
errTim Meinhardt; Alexander Kirillov; Laura Leal-Taixe; Christoph Feichtenhofer
errShare
errSave
researcher View more