arrow
Return

Motion-guided Visual Tracking

delete2025-08-19
delete0
PRE
AI
P
Pengyu Zhang
S
Simiao Lai
D
Dong Wang *
H
Huchuan Lu
DOI:10.1007/s11633-023-1477-xdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Motion information is a crucial cue to build a robust tracker, especially in handling object occlusion and fast drift caused by cameras and objects. However, it has not been fully exploited. In this study, we attempt to exploit motion cues to guide visual trackers without bells and whistles. First, we decouple motion into two types: camera motion and object motion. Then, we predict them individually via the proposed camera motion modeling and object trajectory prediction. Each module contains a motion detector and a verifier. As for camera motion, we apply the off-the-shelf keypoint matching method to detect camera movement and propose a novel self-supervised camera motion verifier to validate its confidence. Given the previous object trajectory, object trajectory prediction aims to predict the future location of the target and select a reliable trajectory to handle fast object motion and occlusion. Numerous experiments on several mainstream tracking datasets, including OTB100, DTB70, TC128, UAV123, VOT2018 and GOT10k, demonstrate the effectiveness and generalization ability of our module, with real-time speed.
Keywords:
Visual tracking
motion embedding
camera motion modeling
self-supervised learning
trajectory prediction

Journal

Machine Intelligence Research cover
Machine Intelligence Research
IF:
8.7
Papers:
304
Citations:
882

Organization

S
School of Information and Communication Engineering
Scholars:
176
Papers: 74
Citations: 0
Cited Papers

Cited Papers

A Benchmark and Simulator for UAV Tracking
err2016-09-17
err0
PREAI
errMatthias Mueller; Neil Smith; Bernard Ghanem
errShare
errSave
Jointly Modeling Motion and Appearance Cues for Robust RGB-T Tracking
err2021-01-01
err103
errOAAI
errZhang, Pengyu; Zhao, Jie; Bo, Chunjuan; Wang, Dong; Lu, Huchuan; Yang, Xiaoyun
errShare
errSave
S4L: Self-Supervised Semi-Supervised Learning
err2019-10-01
err0
errOAAI
errXiaohua Zhai; Avital Oliver; Alexander Kolesnikov; Lucas Beyer
errShare
errSave
ECO: Efficient Convolution Operators for Tracking
err2017-07-01
err0
errOAAI
errMartin Danelljan; Goutam Bhat; Fahad Shahbaz Khan; Michael Felsberg
errShare
errSave
Counter-Hypothetical Particle Filters for Single Object Pose Tracking
err2023-05-29
err0
PREAI
errOlson,Elizabeth A.; Pavlasek,Jana; Berry,Jasmine A.; Jenkins,Odest Chadwicke
errShare
errSave
researcher View more