arrow
Return

TRAT: Tracking by attention using spatio-temporal features

delete2022-07-01
delete18
delete
OA
AI
H
Hasan Sarıbaş
H
Hakan Çevıkalp *
O
Okan Köpüklü
B
Bedirhan Uzun
DOI:10.1016/j.neucom.2022.04.043delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Robust object tracking requires knowledge of tracked objects' appearance, motion and their evolution over time. Although motion provides distinctive and complementary information especially for fast moving objects, most of the recent tracking architectures primarily focus on the objects' appearance information. In this paper, we propose a two-stream deep neural network tracker that uses both spatial and temporal features. Our architecture is developed over ATOM tracker and contains two backbones: (i) 2D-CNN network to capture appearance features and (ii) 3D-CNN network to capture motion features. The features returned by the two networks are then fused with attention based Feature Aggregation Module (FAM). Since the whole architecture is unified, it can be trained end-to-end. The experimental results show that the proposed tracker TRAT (TRacking by ATtention) achieves the state-of-the-art performance on most of the benchmarks and it significantly outperforms the baseline ATOM tracker. The source code and pretrained models can be found at https://github.com/Hasan4825/TRAT.(c) 2022 Elsevier B.V. All rights reserved.
Keywords:
Tracking
Two-stream network
3D CNN
Feature aggregation module
Channel attention
Temporal features
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

E
Eskisehir Osmangazi University
Scholars:
2.8K
Papers: 2.4K
Citations: 2
T
Technical University of Munich
Scholars:
5.2W
Papers: 3.9W
Citations: 6.2W
E
Eskisehir Technical University
Scholars:
1.2K
Papers: 1.1K
Citations: 824
researcher View more organizations