arrow
Return

Performance Evaluation Methodology for Long-Term Single-Object Tracking

delete2021-12-01
delete17
PRE
AI
A
Alan Lukežič *
L
Luka Čehovin Zajc
V
Vojir, Tomas
J
Jiřı́ Matas
M
Matej Kristan
DOI:10.1109/TCYB.2020.2980618delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
A long-term visual object tracking performance evaluation methodology and a benchmark are proposed. Performance measures are designed by following a long-term tracking definition to maximize the analysis probing strength. The new measures outperform existing ones in interpretation potential and in better distinguishing between different tracking behaviors. We show that these measures generalize the short-term performance measures, thus linking the two tracking problems. Furthermore, the new measures are highly robust to temporal annotation sparsity and allow annotation of sequences hundreds of times longer than in the current datasets without increasing manual annotation labor. A new challenging dataset of carefully selected sequences with many target disappearances is proposed. A new tracking taxonomy is proposed to position trackers on the short-term/long-term spectrum. The benchmark contains an extensive evaluation of the largest number of long-term trackers and comparison to state-of-the-art short-term trackers. We analyze the influence of tracking architecture implementations to long-term performance and explore various redetection strategies as well as the influence of visual model update strategies to long-term tracking drift. The methodology is integrated in the VOT toolkit to automate experimental analysis and benchmarking and to facilitate the future development of long-term trackers.
Keywords:
Target tracking
Benchmark testing
Performance evaluation
Visualization
Annotations
Current measurement
Long-term tracking
performance measures
tracking benchmark
visual object tracking

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

C
czech technical university prague
Scholars:
6.6K
Papers: 5.3K
Citations: 3
U
University of Ljubljana
Scholars:
1.5W
Papers: 1.3W
Citations: 1.7W
U
University of Cambridge
Scholars:
7.7W
Papers: 7.1W
Citations: 13.7W
researcher View more organizations
Cited Papers

Cited Papers

errShare
errSave
errShare
errSave
Trust in Virtual Teams: A Multidisciplinary Review and Integration
err2019-01-21
err0
errOAAI
errJanine Viol Hacker; Michael Johnson; Carol Saunders; Amanda L. Thayer
errShare
errSave
Molecular Taxonomy of Phytopathogenic Fungi: A Case Study in Peronospora
err2009-07-29
err0
errOAAI
errMarkus Göker; Gema García-Blázquez; Hermann Voglmayr; M. Teresa Tellería; María P. Martín
errShare
errSave
NK cell CD16 surface expression and function is regulated by a disintegrin and metalloprotease-17 (ADAM17)
err2013-05-02
err0
errOAAI
errRizwan Romee; Bree Foley; Todd Lenvik; Yue Wang; Bin Zhang; Dave Ankarlo; Xianghua Luo; Sarah Cooley; Mike Verneris; Bruce Walcheck; Jeffrey Miller
errShare
errSave
Magnetic properties of magnetite nanoparticles synthesized by forced hydrolysis
err2008-10-01
err0
PREAI
errM.E. Compeán-Jasso; Facundo Ruiz; J.R. Martínez; A. Herrera-Gómez
errShare
errSave
errShare
errSave
Characterization and magnetism of Co-modified γ-Fe2O3 core–shell nanoparticles by enhancement using NaOH
err2015-01-01
err0
PREAI
errJunming Li; Jian Li; Longlong Chen; Yueqiang Lin; Xiaodong Liu; Xiaomin Gong; Decai Li
errShare
errSave
researcher View more