arrow
返回

Siamese Deformable Cross-Correlation Network for Real-Time Visual Tracking

delete2020-08-01
delete15
PRE
AI
L
Linyu Zheng
陈
陈盈盈 (Yingying Chen) *
M
Ming Tang
J
Jinqiao Wang
卢
卢汉清 (Hanqing Lu)
DOI:10.1016/j.neucom.2020.02.080delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In recent years, SiamFC-based trackers have received much attention because of their great potentials in balancing tracking accuracy and speed. However, the robustness of most such trackers is greatly affected by the large deformations of targets. We argue that in the cross-correlation operation which is widely used by modern SiamFC-based trackers, the static correlation between the template kernel and the feature maps of test sample is difficult to adapt to the large deformation of the target object. In this paper, we propose a Siamese deformable cross-correlation network (SiamDCN), which introduces the deformable cross-correlation operation into SiamFC in an online self-adaptive way, for robust visual tracking. Compared to the previous SiamFC-based trackers, our SiamDCN is more robust to the large deformations of targets through dynamically and adaptively adjusting the location of correlation calculation for each element of the template kernel in the cross-correlation operation. Moreover, we build a twofold Siamese network, named SiamDCN+, which consists of a SiamDCN branch and a SiamFC branch, for accurate and real-time visual tracking after observing that the features learned in SiamFC are static and discriminative, whereas those in SiamDCN are dynamic and robust, and they complement each other. Extensive experiments on three public benchmarks, 0TB2015, V0T2016, and V0T2017, show that the proposed SiamDCN achieves superior localization accuracy than its baseline tracker SiamFC and the proposed SiamDCN+ achieves competitive performance compared to state-of-the-art real-time trackers, while running beyond 40 FPS. (C) 2020 Elsevier B.V. All rights reserved.
Keyword:
Visual Tracking
Convolutional Neural Networks
Siamese network
Deformable Convolutional Network

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

err分享
err收藏
Correlation filter tracker with siamese: A robust and real-time object tracking framework
err2019-09-01
err12
PREAI
errPan, Gengzheng; Chen, Guochun; Kang, Wenxiong; Hou, Junhui
err分享
err收藏
Visual tracking using Siamese convolutional neural network with region proposal and domain specific updating
err2018-01-01
err26
PREAI
errZhang, Han; Ni, Weiping; Yan, Weidong; Wu, Junzheng; Bian, Hui; Xiang, Deliang
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
Targeted mutation of zebrafish fga models human congenital afibrinogenemia
err2014-04-03
err0
errOAAI
errRichard J. Fish; Corinne Di Sanza; Marguerite Neerman-Arbez
err分享
err收藏
Fast RGB-T Tracking via Cross-Modal Correlation Filters
err2019-03-01
err58
PREAI
errZhai, Sulan; Shao, Pengpeng; Liang, Xinyan; Wang, Xin
err分享
err收藏
Learning spatially regularized similarity for robust visual tracking
err2017-04-01
err3
PREAI
errZhou, Xiuzhuang; Huo, Qirun; Shang, Yuanyuan; Xu, Min; Ding, Hui
err分享
err收藏
err分享
err收藏
学者 查看更多内容