arrow
Return

TMTB: Transformer based multi-task branching multi-object tracking algorithm for wide-view scenes

delete2023-10-11
delete0
PRE
AI
李洪均 cover
李洪均 (Hongjun Li) *
J
Jiaxin Li
DOI:10.1007/s11042-023-17255-zdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Combining Unmanned aerial vehicle (UAV) with artificial intelligence can effectively extract information as UAV fly flexibly and have a wide view, but the current processing efficiency of the video information acquired by UAV is low, resulting in insufficient use of resources. In order to enable the tracking algorithm to adapt to wide-angle target scenes and fully utilize the acquired information, we propose a transformer based multi-task branching multi-object tracking algorithm named TMTB. Firstly, a transformer architecture backbone network is designed for extracting target features; then, feature enhancement of multi-stage features through differently focused task branches to suit different objectives in a broad view; finally, the tracking algorithm is optimised according to the motion characteristics of the target in the scene to achieve multi-object tracking in UAV scenes. Experimental results on the VisDrone-MOT2019, and the MOTA is improved by 5.9% compared to JDE, and the operation speed is improved by 75%. The proposed algorithm has good real-time performance and good tracking effect.
Keywords:
Multi-object tracking
Multi-task branches
Wide-view scenes
Unmanned aerial vehicle
Transformer

Journal

Multimedia Tools and Applications cover
Multimedia Tools and Applications
IF:
3
Papers:
2.0W
Citations:
3.2W

Organization

N
Nantong University
Scholars:
1.9W
Papers: 1.1W
Citations: 2.0W
Cited Papers

Cited Papers

CSR through the heart of the Bodhi tree
err2012-06-01
err0
PREAI
errSuthisak Kraisornsuthasinee
errShare
errSave
errShare
errSave
errShare
errSave
MPAT: multi-path attention temporal method for video anomaly detection
err2022-09-22
err5
PREAI
errLi, Hongjun; Sun, Xiaohu; Li, Chaobo; Shen, Xulin; Chen, Jinyi; Chen, Junjie; Xie, Zhengguang
errShare
errSave
Tracking-by-Counting: Using Network Flows on Crowd Density Maps for Tracking Multiple Targets
err2021-01-01
err69
errOAAI
errRen, Weihong; Wang, Xinchao; Tian, Jiandong; Tang, Yandong; Chan, Antoni B.
errShare
errSave
Synthesis of n-type semiconducting diamond film using diphosphorus pentaoxide as the doping source
err1990-10-01
err0
PREAI
errKen Okano; Hideo Kiyota; Tatsuya Iwasaki; Yoshitaka Nakamura; Yukio Akiba; Tateki Kurosu; Masamori Iida; Terutaro Nakamura
errShare
errSave
A Procedure for Scaling Perceptions of Lodging Quality
err2018-04-24
err0
PREAI
errJuliet M. Getty; Kenneth N. Thompson
errShare
errSave
researcher View more