.png){kind=icon}
返回
Temporal relation transformer for robust visual tracking with dual-memory learning
.png){kind=icon}
PRE
AI
DOI：10.1016/j.asoc.2024.112229.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Recently, transformer trackers mostly associate multiple reference images with the search area to adapt to the changing appearance of the target. However, they ignore the learned cross-relations between the target and surrounding, leading to difficulties in building coherent contextual models for specific target instances. This paper presents a Temporal Relation Transformer Tracker (TRTT) for robust visual tracking, providing a concise approach to modeling temporal relations by dual target memory learning. Specifically, a temporal relation transformer network generates paired memories based on static and dynamic templates, which are reinforced interactively. The memory contains implicit relation hints that capture the relations between the tracked object and its immediate surroundings. More importantly, to ensure consistency of target instance identities between frames, the relation hints from previous frames are transferred to the current frame for merging temporal contextual attention. Our method also incorporates mechanisms for reusing favorable cross-relations and instance-specific features, thereby overcoming background interference in complex spatio-temporal interactions through a sequential constraint. Furthermore, we design a memory token sparsification method that leverages the key points of the target to eliminate interferences and optimize attention calculations. Extensive experiments demonstrate that our method surpasses advanced trackers on 8 challenging benchmarks while maintaining real-time running speed.
Keyword:
Visual tracking
Transformer
Temporal relation modeling
Memory mechanism
期刊
IF:
6.6
论文数:
1.4W
被引数:
4.8W
机构
引用论文
分享收藏Optimal design of a manufacturing-remanufacturing-transport system within a reverse logistics chain
PREAI
分享收藏A novel flake-ball-like magnetic Fe3O4/γ-MnO2 meso-porous nano-composite: Adsorption of fluorinion and effect of water chemistry.png)
Chemosphere
ChemosphereIF0
PREAI
分享收藏Role of Urban Landscapes in Changing the Irrigation Water Requirements in Arid ClimateGeosciences
OAAI
GeosciencesIF0
OAAI分享收藏Geriatric Assessments and Medication Therapy Management Approaches in Elderly Oncology Patients
PREAI
分享收藏
查看更多内容