arrow
Return

Target-background interaction modeling transformer for object tracking

delete2025-04-01
delete1
PRE
AI
H
Huanlong Zhang
W
Weiqiang Fu
祁瑞 cover
祁瑞 (Rui Qi)
B
Bineng Zhong
X
Xin Wang
王
王延峰 (Yanfeng Wang)
DOI:10.1016/j.knosys.2025.113230delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
One-stream transformer trackers have received widespread attention for their excellent discriminatory ability. However, most of the existing trackers try to mine more information on the target while ignoring the exploitation of the background around it. In this study, we present a one-stream target-background interaction modeling transformer for object tracking. On the one hand, to mitigate the effect of interclass scenarios, a transformer-based target-background interaction model is proposed. This model performs multiview spatiotemporal attention modeling from 2D to 3D, fully exploring the relational dependencies between the target context and the search region. The model maximizes the acquisition of high-quality tokens for target representation by minimizing the influence of pure background tokens. On the other hand, by considering the intraclass strong similarity distractors, a progressive state-aware module is designed to optimize the feature structure used for representing the target. This module aggregates the historical state of the target into the self-attention mechanism, which learns the positional relationship between the target and the distractors in the current frame, to adaptively highlight the weight of the target. By jointly learning interclass variability and intraclass similarity, our method can more accurately reveal the composition and structure of target features, improving its visual perception in complex scenes. Extensive experiments on seven benchmarks compared to existing state-of-the-art trackers demonstrate the effectiveness of our proposed method.
Keywords:
Object tracking
Target representation
Transformer tracking
Target-background interaction

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

No organization information available
Cited Papers

Cited Papers

Siamese Box Adaptive Network for Visual Tracking
err2020-06-01
err0
errOAAI
errZedu Chen; Bineng Zhong; Guorong Li; Shengping Zhang; Rongrong Ji
errShare
errSave
Distractor-Aware Fast Tracking via Dynamic Convolutions and MOT Philosophy
err2021-06-01
err0
errOAAI
errZikai Zhang; Bineng Zhong; Shengping Zhang; Zhenjun Tang; Xin Liu; Zhaoxiang Zhang
errShare
errSave
Autoregressive Queries for Adaptive Tracking with Spatio-Temporal Transformers
err2024-06-16
err0
PREAI
errJinxia Xie; Bineng Zhong; Zhiyi Mo; Shengping Zhang; Liangtao Shi; Shuxiang Song; Rongrong Ji
errShare
errSave
Transforming Model Prediction for Tracking
err2022-06-01
err0
errOAAI
errChristoph Mayer; Martin Danelljan; Goutam Bhat; Matthieu Paul; Danda Pani Paudel; Fisher Yu; Luc Van Gool
errShare
errSave
Sequential Fusion Based Multi-Granularity Consistency for Space-Time Transformer Tracking
err2024-03-24
err0
errOAAI
errKun Hu; Wenjing Yang; Wanrong Huang; Xianchen Zhou; Mingyu Cao; Jing Ren; Huibin Tan
errShare
errSave
errShare
errSave
High-Performance Discriminative Tracking with Transformers
err2021-10-01
err0
PREAI
errBin Yu; Ming Tang; Linyu Zheng; Guibo Zhu; Jinqiao Wang; Hao Feng; Xuetao Feng; Hanqing Lu
errShare
errSave
researcher View more