Enhancing the Two-Stream Framework for Efficient Visual Tracking

Chengao Zong

doi:10.1109/TIP.2025.3598934

2025-01-01

PRE

DOI：10.1109/TIP.2025.3598934

原文链接

原文求助

摘要

En 中文

实际部署，特别是在资源受限的边缘设备上，对视觉目标跟踪器提出了高速要求。为满足这一需求，我们提出了一种名为ToS的新型高效跟踪器，采用双流架构。尽管近期采用统一骨干网络以同时处理模板和搜索区域的一流跟踪框架已展现出卓越效果，但我们发现采用两个独立骨干网络分别处理模板和搜索区域的常规双流跟踪框架具有固有优势。双流跟踪框架更易于适配先进的轻量级骨干网络，并能有效利用大模板带来的益处。我们证明，通过策略性设计，双流架构在速度和精度上均可超越一流跟踪模型。我们的方法通过轻量级预训练骨干网络以及提出的三大高效策略，为双流跟踪范式注入新活力：1）一种特征聚合模块，用以提升骨干网络的表征能力；2）一种通道级特征融合方法，为空间拼接技术提供更有效且更轻量的替代方案；3）一种扩展模板策略，用以提升跟踪精度，同时引入可忽略不计的额外计算开销。在多个跟踪基准上的广泛评估表明，所提出的方法在高效视觉跟踪领域达到了新的最佳性能。

Keyword:

Efficient visual tracking

two-stream framework

feature aggregation

feature fusion

期刊

IEEE Transactions on Image Processing

IF:

13.7

论文数:

1.0W

被引数:

8.4W

机构

City University of Hong Kong

学者数:

2.3W

论文数: 3.0W

被引数: 6.1W

Dalian University of Technology

学者数:

6.0W

论文数: 4.4W

被引数: 5.5W

引用论文

A Benchmark and Simulator for UAV Tracking

Lecture Notes in Computer Science

IF0

2016-09-17

PREAI

Matthias Mueller; Neil Smith; Bernard Ghanem

Robust Online Tracking With Meta-Updater

IEEE Transactions on Pattern Analysis and Machine Intelligence

IF0

2022-01-01

PREAI

Jie Zhao; Kenan Dai; Pengyu Zhang; Dong Wang; Huchuan Lu

The Ninth Visual Object Tracking VOT2021 Challenge Results

2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)

IF0

2021-10-01

OAAI

Matej Kristan; Jiri Matas; Ales Leonardis; Michael Felsberg; Roman Pflugfelder; Joni-Kristian Kamarainen; Hyung Jin Chang; Martin Danelljan; Luka Cehovin Zajc; Alan Lukezic; Ondrej Drbohlav; Jani Kapyla; Gustav Hager; Song Yan; Jinyu Yang; Zhongqun Zhang; Gustavo Fernandez; Mohamed Abdelpakey; Goutam Bhat; Llukman Cerkezi; Hakan Cevikalp; Shengyong Chen; Xin Chen; Miao Cheng; Ziyi Cheng; Yu-Chen Chiu; Ozgun Cirakman; Yutao Cui; Kenan Dai; Mohana Murali Dasari; Qili Deng; Xingping Dong; Daniel K. Du; Matteo Dunnhofer; Zhen-Hua Feng; Zhiyong Feng; Zhihong Fu; Shiming Ge; Rama Krishna Gorthi; Yuzhang Gu; Bilge Gunsel; Qing Guo; Filiz Gurkan; Wencheng Han; Yanyan Huang; Felix Jaremo Lawin; Shang-Jhih Jhang; Rongrong Ji; Cheng Jiang; Yingjie Jiang; Felix Juefei-Xu; Yin Jun; Xiao Ke; Fahad Shahbaz Khan; Byeong Hak Kim; Josef Kittler; Xiangyuan Lan; Jun Ha Lee; Bastian Leibe; Hui Li; Jianhua Li; Xianxian Li; Yuezhou Li; Bo Liu; Chang Liu; Jingen Liu; Li Liu; Qingjie Liu; Huchuan Lu; Wei Lu; Jonathon Luiten; Jie Ma; Ziang Ma; Niki Martinel; Christoph Mayer; Alireza Memarmoghadam; Christian Micheloni; Yuzhen Niu; Danda Paudel; Houwen Peng; Shoumeng Qiu; Aravindh Rajiv; Muhammad Rana; Andreas Robinson; Hasan Saribas; Ling Shao; Mohamed Shehata; Furao Shen; Jianbing Shen; Kristian Simonato; Xiaoning Song; Zhangyong Tang; Radu Timofte; Philip Torr; Chi-Yi Tsai; Bedirhan Uzun; Luc Van Gool; Paul Voigtlaender; Dong Wang; Guangting Wang; Liangliang Wang; Lijun Wang; Limin Wang; Linyuan Wang; Yong Wang; Yunhong Wang; Chenyan Wu; Gangshan Wu; Xiao-Jun Wu; Fei Xie; Tianyang Xu; Xiang Xu; Wanli Xue; Bin Yan; Wankou Yang; Xiaoyun Yang; Yu Ye; Jun Yin; Chengwei Zhang; Chunhui Zhang; Haitao Zhang; Kaihua Zhang; Kangkai Zhang; Xiaohan Zhang; Xiaolin Zhang; Xinyu Zhang; Zhibin Zhang; Shaochuan Zhao; Ming Zhen; Bineng Zhong; Jiawen Zhu; Xue-Feng Zhu

Autoregressive Visual Tracking

2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

IF0

2023-06-01

PREAI

Xing Wei; Yifan Bai; Yongchao Zheng; Dahu Shi; Yihong Gong

Toward Robust Visual Object Tracking With Independent Target-Agnostic Detection and Effective Siamese Cross-Task Interaction 通过独立的目标不可知检测和有效的连体跨任务交互实现鲁棒的视觉对象跟踪

IEEE TRANSACTIONS ON IMAGE PROCESSING

IF13.7

2023-01-01

PREAI

Xu, Tianyang; Feng, Zhenhua; Wu, Xiao-Jun; Kittler, Josef

Exploring Lightweight Hierarchical Vision Transformers for Efficient Visual Tracking

2023 IEEE/CVF International Conference on Computer Vision (ICCV)

IF0

2023-10-01

OAAI

Ben Kang; Xin Chen; Dong Wang; Houwen Peng; Huchuan Lu

The Eighth Visual Object Tracking VOT2020 Challenge Results

Lecture Notes in Computer Science

IF0

2021-01-31

PREAI

Matej Kristan; Aleš Leonardis; Jiří Matas; Michael Felsberg; Roman Pflugfelder; Joni-Kristian Kämäräinen; Martin Danelljan; Luka Čehovin Zajc; Alan Lukežič; Ondrej Drbohlav; Linbo He; Yushan Zhang; Song Yan; Jinyu Yang; Gustavo Fernández; Alexander Hauptmann; Alireza Memarmoghadam; Álvaro García-Martín; Andreas Robinson; Anton Varfolomieiev; Awet Haileslassie Gebrehiwot; Bedirhan Uzun; Bin Yan; Bing Li; Chen Qian; Chi-Yi Tsai; Christian Micheloni; Dong Wang; Fei Wang; Fei Xie; Felix Jaremo Lawin; Fredrik Gustafsson; Gian Luca Foresti; Goutam Bhat; Guangqi Chen; Haibin Ling; Haitao Zhang; Hakan Cevikalp; Haojie Zhao; Haoran Bai; Hari Chandana Kuchibhotla; Hasan Saribas; Heng Fan; Hossein Ghanei-Yakhdan; Houqiang Li; Houwen Peng; Huchuan Lu; Hui Li; Javad Khaghani; Jesus Bescos; Jianhua Li; Jianlong Fu; Jiaqian Yu; Jingtao Xu; Josef Kittler; Jun Yin; Junhyun Lee; Kaicheng Yu; Kaiwen Liu; Kang Yang; Kenan Dai; Li Cheng; Li Zhang; Lijun Wang; Linyuan Wang; Luc Van Gool; Luca Bertinetto; Matteo Dunnhofer; Miao Cheng; Mohana Murali Dasari; Ning Wang; Ning Wang; Pengyu Zhang; Philip H. S. Torr; Qiang Wang; Radu Timofte; Rama Krishna Sai Gorthi; Seokeon Choi; Seyed Mojtaba Marvasti-Zadeh; Shaochuan Zhao; Shohreh Kasaei; Shoumeng Qiu; Shuhao Chen; Thomas B. Schön; Tianyang Xu; Wei Lu; Weiming Hu; Wengang Zhou; Xi Qiu; Xiao Ke; Xiao-Jun Wu; Xiaolin Zhang; Xiaoyun Yang; Xuefeng Zhu; Yingjie Jiang; Yingming Wang; Yiwei Chen; Yu Ye; Yuezhou Li; Yuncon Yao; Yunsung Lee; Yuzhang Gu; Zezhou Wang; Zhangyong Tang; Zhen-Hua Feng; Zhijun Mai; Zhipeng Zhang; Zhirong Wu; Ziang Ma

Spatial-temporal initialization dilemma: towards realistic visual tracking 时空初始化困境：面向真实的视觉跟踪

Visual Intelligence

IF0

2024-12-30

OAAI

Chang Liu; Yongsheng Yuan; Xin Chen; Huchuan Lu; Dong Wang

CornerNet: Detecting Objects as Paired Keypoints

Lecture Notes in Computer Science

IF0

2018-10-09

PREAI

Hei Law; Jia Deng

Attention Is All You Need 注意是你所需要的

IF0

OAAI

查看更多内容