arrow
返回

RCFT: re-parameterization convolution and feature filter for object tracking

delete2023-09-15
delete0
delete
OA
AI
Y
Yuanyun Wang
W
Wenhui Yang
P
Peng Yin
J
Jun Wang *
DOI:10.1007/s40747-023-01223-zdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Siamese-based trackers have been widely studied for their high accuracy and speed. Both the feature extraction and feature fusion are two important components in Siamese-based trackers. Siamese-based trackers obtain fine local features by traditional convolution. However, some important channel information and global information are lost when enhancing local features. In the feature fusion process, cross-correlation-based feature fusion between the template and search region feature ignores the global spatial context information and does not make the best of the spatial information. In this paper, to solve the above problem, we design a novel feature extraction sub-network based on batch-free normalization re-parameterization convolution, which scales the features in the channel dimension and increases the receptive field. Richer channel information is obtained and powerful target features are extracted for the feature fusion. Furthermore, we learn a feature fusion network (FFN) based on feature filter. The FFN fuses the template and search region features in a global spatial context to obtain high-quality fused features by enhancing important features and filtering redundant features. By jointly learning the proposed feature extraction sub-network and FFN, the local and global information are fully exploited. Then, we propose a novel tracking algorithm based on the designed feature extraction sub-network and FFN with re-parameterization convolution and feature filter, referred to as RCFT. We evaluate the proposed RCFT tracker and some recent state-of-the-art (SOTA) trackers on OTB100, VOT2018, LaSOT, GOT-10k, UAV123 and the visual-thermal dataset VOT-RGBT2019 datasets, which achieves superior tracking performance with 45 FPS tracking speed.
Keyword:
Object tracking
Feature extraction
Re-parameterization convolution
Feature filter
Feature fusion

期刊

Complex and Intelligent Systems 封面图
Complex and Intelligent Systems
IF:
4.6
论文数:
2.1K
被引数:
6.6K

机构

N
nanchang institute technology
学者数:
1.1K
论文数: 936
被引数: 19
引用论文

引用论文

err分享
err收藏
Active Therapy for Chronic Low Back Pain
err2001-04-01
err0
PREAI
errAnne F. Mannion; Simo Taimela; Markus Müntener; Jiri Dvorak
err分享
err收藏
Trust in Virtual Teams: A Multidisciplinary Review and Integration
err2019-01-21
err0
errOAAI
errJanine Viol Hacker; Michael Johnson; Carol Saunders; Amanda L. Thayer
err分享
err收藏
Definitions of primary-progressive multiple sclerosis trajectories by rate of clinical disability progression
err2021-05-01
err0
PREAI
errAnat Achiron; Sapir Dreyer-Alster; Michael Gurevich; Shay Menascu; David Magalashvili; Mark Dolev; Yael Stern; Tomer Ziv-Baran
err分享
err收藏
An Investigation of IEP Quality Associated With Special Education Placement for Students With Complex Support Needs
err2022-11-01
err0
PREAI
errJennifer A. Kurth; Elissa Lockman Turner; Daria Gerasimova; Tyler A. Hicks; Alison Zagona; Kirsten Lansey; Mary Curran Mansouri; Kristin J. Lyon; Matt Jameson; Roxanne Loyless; Jesse R. Pace
err分享
err收藏
学者 查看更多内容