arrow
Return

Real-Time Multiple Object Visual Tracking for Embedded GPU Systems

delete2021-06-01
delete16
delete
OA
AI
M
Mauro Fernández-Sanjurjo *
M
Manuel Mucientes
V
V.M. Brea
DOI:10.1109/JIOT.2021.3056239delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Real-time visual object tracking provides every object of interest with a unique identity and a trajectory across video frames. This is a fundamental task of many video analytics applications, such as traffic monitoring or video surveillance in general. The development of real-time multiple object tracking systems on low-power edge devices as IoT nodes, without compromising accuracy, is a challenge due to the limited computing capacity of said devices. This might rule out the best in-class computer vision solutions, which, nowadays, are based on deep learning, and thus, they are very hardware demanding. This article meets this challenge with a multiple object detection and tracking system that employs cutting-edge deep learning architectures on an embedded GPU while operating in real time. For this purpose, a system has been designed that extends a joint architecture of tracking and detection by adding a module comprised of appearance-based and movement-based trackers that allow to maintain the identity of the objects of interest for longer periods of time while alleviating the burden of the detector. Our system is mapped onto an embedded GPU platform, cutting down power consumption significantly with respect to a server GPU. Tracking performance metrics show a 51.1% in multiple object tracking accuracy (MOTA) on the MOT16 data set. This, in conjunction with a real-time processing speed of 25.2 FPS for up to 45 simultaneous objects and low-power consumption of 15 W, make our system an ideal solution for a wide range of video analytics applications.
Keywords:
Real-time systems
Feature extraction
Detectors
Deep learning
Hardware
Computer vision
Computer architecture
Deep learning
edge computing
multiple object tracking
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Internet of Things Journal cover
IEEE Internet of Things Journal
IF:
8.9
Papers:
1.4W
Citations:
7.8W

Organization

U
Universidade de Santiago de Compostela
Scholars:
1.5W
Papers: 1.3W
Citations: 1.4W