arrow
返回

RelationTrack: Relation-Aware Multiple Object Tracking With Decoupled Representation

delete2023-01-01
delete74
delete
OA
AI
E
En Yu
Z
Zhuoling Li
韩守东 (Shoudong Han) *
H
Hongwei Wang
DOI:10.1109/TMM.2022.3150169delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Existing online multiple object tracking (MOT) algorithms often consist of two subtasks, detection and re-identification (ReID). In order to enhance the inference speed and reduce the complexity, current methods commonly integrate these double subtasks into a unified framework. Nevertheless, detection and ReID demand diverse features. This issue results in an optimization contradiction during the training procedure. With the target of alleviating this contradiction, we devise a module named Global Context Disentangling (GCD) that decouples the learned representation into detection-specific and ReID-specific embeddings. As such, this module provides an implicit manner to balance the different requirements of these two subtasks. Moreover, we observe that preceding MOT methods typically leverage local information to associate the detected targets and neglect to consider the global semantic relation. To resolve this limitation, we develop a module, referred to as Guided Transformer Encoder (GTE), by combining the powerful reasoning ability of Transformer encoder and deformable attention. Unlike previous works, GTE avoids analyzing all the pixels and only attends to capture the relation between query nodes and a few self-adaptively selected key samples. Therefore, it is computationally efficient. Extensive experiments have been conducted on the MOT16, MOT17 and MOT20 benchmarks to demonstrate the superiority of the proposed MOT framework, namely RelationTrack. The experimental results indicate that RelationTrack has surpassed preceding methods significantly and established a new state-of-the-art performance, e.g., IDF1 of 70.5% and MOTA of 67.2% on MOT20.
Keyword:
Decoupling representation
deformable attention
multiple object tracking
optimization contradiction
transformer encoder

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.5K
被引数:
2.4W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
引用论文

引用论文

Comparative analysis of occlusion methods for artificial sphincters人工括约肌闭塞方法的比较分析
err2020-04-07
err0
PREAI
errLeonardo Marziale; Gioia Lucarini; Tommaso Mazzocchi; Leonardo Ricotti; Arianna Menciassi
err分享
err收藏
MAT: Motion-aware multi-object tracking
err2022-03-01
err94
errOAAI
errHan, Shoudong; Huang, Piao; Wang, Hongwei; Yu, En; Liu, Donghaisheng; Pan, Xiaofeng
err分享
err收藏
Rasmussen encephalitis: Epilepsia partialis continua secondary to chronic encephalitis
err1990-11-01
err0
PREAI
errMary L. Zupanc; Eric G. Handler; Ross L. Levine; Timothy W. Jahn; Gabriele M. ZuRhein; Jack M. Rozental; Robert J. Nickles; Curtis R. Partington
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
A Procedure for Scaling Perceptions of Lodging Quality
err2018-04-24
err0
PREAI
errJuliet M. Getty; Kenneth N. Thompson
err分享
err收藏
学者 查看更多内容