arrow
Return

Enhancing the Two-Stream Framework for Efficient Visual Tracking

delete2025-01-01
delete0
PRE
AI
C
Chengao Zong
X
Xin Chen
J
Jie Zhao
Y
Yang Liu
卢
卢湖川 (Huchuan Lu)
D
Dong Wang
DOI:10.1109/TIP.2025.3598934delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Practical deployments, especially on resource-limited edge devices, necessitate high speed for visual object trackers. To meet this demand, we introduce a new efficient tracker with a Two-Stream architecture, named ToS. While the recent one-stream tracking framework, employing a unified backbone for simultaneous processing of both the template and search region, has demonstrated exceptional efficacy, we find the conventional two-stream tracking framework, which employs two separate backbones for the template and search region, offers inherent advantages. The two-stream tracking framework is more compatible with advanced lightweight backbones and can efficiently utilize benefits from large templates. We demonstrate that the two-stream setup can exceed the one-stream tracking model in both speed and accuracy through strategic designs. Our methodology rejuvenates the two-stream tracking paradigm with lightweight pre-trained backbones and the proposed three efficient strategies: 1) A feature-aggregation module that improves the representation capability of the backbone, 2) A channel-wise approach for feature fusion, presenting a more effective and lighter alternative to spatial concatenation techniques, and 3) An expanded template strategy to boost tracking accuracy with negligible additional computational cost. Extensive evaluations across multiple tracking benchmarks demonstrate that the proposed method sets a new state-of-the-art performance in efficient visual tracking.
Keywords:
Efficient visual tracking
two-stream framework
feature aggregation
feature fusion

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

C
City University of Hong Kong
Scholars:
2.3W
Papers: 3.0W
Citations: 6.1W
D
Dalian University of Technology
Scholars:
6.0W
Papers: 4.4W
Citations: 5.5W
Cited Papers

Cited Papers

A Benchmark and Simulator for UAV Tracking
err2016-09-17
err0
PREAI
errMatthias Mueller; Neil Smith; Bernard Ghanem
errShare
errSave
Robust Online Tracking With Meta-Updater
err2022-01-01
err0
PREAI
errJie Zhao; Kenan Dai; Pengyu Zhang; Dong Wang; Huchuan Lu
errShare
errSave
The Ninth Visual Object Tracking VOT2021 Challenge Results
err2021-10-01
err0
errOAAI
errMatej Kristan; Jiri Matas; Ales Leonardis; Michael Felsberg; Roman Pflugfelder; Joni-Kristian Kamarainen; Hyung Jin Chang; Martin Danelljan; Luka Cehovin Zajc; Alan Lukezic; Ondrej Drbohlav; Jani Kapyla; Gustav Hager; Song Yan; Jinyu Yang; Zhongqun Zhang; Gustavo Fernandez; Mohamed Abdelpakey; Goutam Bhat; Llukman Cerkezi; Hakan Cevikalp; Shengyong Chen; Xin Chen; Miao Cheng; Ziyi Cheng; Yu-Chen Chiu; Ozgun Cirakman; Yutao Cui; Kenan Dai; Mohana Murali Dasari; Qili Deng; Xingping Dong; Daniel K. Du; Matteo Dunnhofer; Zhen-Hua Feng; Zhiyong Feng; Zhihong Fu; Shiming Ge; Rama Krishna Gorthi; Yuzhang Gu; Bilge Gunsel; Qing Guo; Filiz Gurkan; Wencheng Han; Yanyan Huang; Felix Jaremo Lawin; Shang-Jhih Jhang; Rongrong Ji; Cheng Jiang; Yingjie Jiang; Felix Juefei-Xu; Yin Jun; Xiao Ke; Fahad Shahbaz Khan; Byeong Hak Kim; Josef Kittler; Xiangyuan Lan; Jun Ha Lee; Bastian Leibe; Hui Li; Jianhua Li; Xianxian Li; Yuezhou Li; Bo Liu; Chang Liu; Jingen Liu; Li Liu; Qingjie Liu; Huchuan Lu; Wei Lu; Jonathon Luiten; Jie Ma; Ziang Ma; Niki Martinel; Christoph Mayer; Alireza Memarmoghadam; Christian Micheloni; Yuzhen Niu; Danda Paudel; Houwen Peng; Shoumeng Qiu; Aravindh Rajiv; Muhammad Rana; Andreas Robinson; Hasan Saribas; Ling Shao; Mohamed Shehata; Furao Shen; Jianbing Shen; Kristian Simonato; Xiaoning Song; Zhangyong Tang; Radu Timofte; Philip Torr; Chi-Yi Tsai; Bedirhan Uzun; Luc Van Gool; Paul Voigtlaender; Dong Wang; Guangting Wang; Liangliang Wang; Lijun Wang; Limin Wang; Linyuan Wang; Yong Wang; Yunhong Wang; Chenyan Wu; Gangshan Wu; Xiao-Jun Wu; Fei Xie; Tianyang Xu; Xiang Xu; Wanli Xue; Bin Yan; Wankou Yang; Xiaoyun Yang; Yu Ye; Jun Yin; Chengwei Zhang; Chunhui Zhang; Haitao Zhang; Kaihua Zhang; Kangkai Zhang; Xiaohan Zhang; Xiaolin Zhang; Xinyu Zhang; Zhibin Zhang; Shaochuan Zhao; Ming Zhen; Bineng Zhong; Jiawen Zhu; Xue-Feng Zhu
errShare
errSave
Autoregressive Visual Tracking
err2023-06-01
err0
PREAI
errXing Wei; Yifan Bai; Yongchao Zheng; Dahu Shi; Yihong Gong
errShare
errSave
The Eighth Visual Object Tracking VOT2020 Challenge Results
err2021-01-31
err0
PREAI
errMatej Kristan; Aleš Leonardis; Jiří Matas; Michael Felsberg; Roman Pflugfelder; Joni-Kristian Kämäräinen; Martin Danelljan; Luka Čehovin Zajc; Alan Lukežič; Ondrej Drbohlav; Linbo He; Yushan Zhang; Song Yan; Jinyu Yang; Gustavo Fernández; Alexander Hauptmann; Alireza Memarmoghadam; Álvaro García-Martín; Andreas Robinson; Anton Varfolomieiev; Awet Haileslassie Gebrehiwot; Bedirhan Uzun; Bin Yan; Bing Li; Chen Qian; Chi-Yi Tsai; Christian Micheloni; Dong Wang; Fei Wang; Fei Xie; Felix Jaremo Lawin; Fredrik Gustafsson; Gian Luca Foresti; Goutam Bhat; Guangqi Chen; Haibin Ling; Haitao Zhang; Hakan Cevikalp; Haojie Zhao; Haoran Bai; Hari Chandana Kuchibhotla; Hasan Saribas; Heng Fan; Hossein Ghanei-Yakhdan; Houqiang Li; Houwen Peng; Huchuan Lu; Hui Li; Javad Khaghani; Jesus Bescos; Jianhua Li; Jianlong Fu; Jiaqian Yu; Jingtao Xu; Josef Kittler; Jun Yin; Junhyun Lee; Kaicheng Yu; Kaiwen Liu; Kang Yang; Kenan Dai; Li Cheng; Li Zhang; Lijun Wang; Linyuan Wang; Luc Van Gool; Luca Bertinetto; Matteo Dunnhofer; Miao Cheng; Mohana Murali Dasari; Ning Wang; Ning Wang; Pengyu Zhang; Philip H. S. Torr; Qiang Wang; Radu Timofte; Rama Krishna Sai Gorthi; Seokeon Choi; Seyed Mojtaba Marvasti-Zadeh; Shaochuan Zhao; Shohreh Kasaei; Shoumeng Qiu; Shuhao Chen; Thomas B. Schön; Tianyang Xu; Wei Lu; Weiming Hu; Wengang Zhou; Xi Qiu; Xiao Ke; Xiao-Jun Wu; Xiaolin Zhang; Xiaoyun Yang; Xuefeng Zhu; Yingjie Jiang; Yingming Wang; Yiwei Chen; Yu Ye; Yuezhou Li; Yuncon Yao; Yunsung Lee; Yuzhang Gu; Zezhou Wang; Zhangyong Tang; Zhen-Hua Feng; Zhijun Mai; Zhipeng Zhang; Zhirong Wu; Ziang Ma
errShare
errSave
Spatial-temporal initialization dilemma: towards realistic visual tracking
err2024-12-30
err0
errOAAI
errChang Liu; Yongsheng Yuan; Xin Chen; Huchuan Lu; Dong Wang
errShare
errSave
errShare
errSave
researcher View more