arrow
返回

Resource-Efficient Visual Multiobject Tracking on Embedded Device

delete2022-06-01
delete1
PRE
AI
J
Jingzheng Tu
陈
陈彩莲 (Cailian Chen) *
许
许齐敏 (Qimin Xu)
杨
杨波 (Bo Yang)
关
关新平 (Xinping Guan)
DOI:10.1109/JIOT.2021.3115102delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multiobject tracking (MOT) is a crucial technology for security surveillance, which is computationally intensive due to the requirement of processing a large number of video streams within low latency in practice. The input video streams of MOT are processed on a cloud computing center with abundant computational capability, posing heavy pressures on delivering video streams to the cloud. Recent advances in the Internet-of-Things (IoT) technology provide edge-computing-based solutions for video analytics at scale. However, the gap between MOT's high computational capability demand and IoT devices' resource-constrained nature remains significant. In this article, a resource-efficient MOT (REMOT) method is proposed for real-time surveillance on IoT embedded devices, including an affinity measurement based on an appearance model with angular triplet loss and a motion association that substitutes the time-consuming graph-based data association stage. Considering the tradeoff between latency and accuracy, we design an optimization strategy on the parallel processing of deep learning models' layers to accelerate the inference speed with less accuracy loss. Besides, we employ a model compression strategy for model size reduction. Experiments on MOT16 and MOT17 benchmarks demonstrate that REMOT reduces 2.4x latency compared with the original implementation and achieves a running speed of 81 frames per second (fps) on an embedded device with only a marginal accuracy loss (6 %), which meets the requirements of real-time processing and low-latency response for surveillance.
Keyword:
Appearance representation
deep learning
edge video analytics
Internet of Things (IoT)
multiobject tracking (MOT)

期刊

IEEE Internet of Things Journal 封面图
IEEE Internet of Things Journal
IF:
8.9
论文数:
1.4W
被引数:
7.8W

机构

S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
引用论文

引用论文

A high-throughput immobilized bead screen for stable proteins and multi-protein complexes
err2011-06-03
err0
errOAAI
errM. A. Lockard; P. Listwan; J.-D. Pedelacq; S. Cabantous; H. B. Nguyen; T. C. Terwilliger; G. S. Waldo
err分享
err收藏
err分享
err收藏
ST-DeepHAR: Deep Learning Model for Human Activity Recognition in IoHT Applications
err2021-03-15
err75
PREAI
errAbdel-Basset, Mohamed; Hawash, Hossam; Chakrabortty, Ripon K.; Ryan, Michael; Elhoseny, Mohamed; Song, Houbing
err分享
err收藏
Cascading Scene and Viewpoint Feature Learning for Pedestrian Gender Recognition
err2021-02-15
err9
PREAI
errCai, Lei; Zeng, Huanqiang; Zhu, Jianqing; Cao, Jiuwen; Wang, Yongtao; Ma, Kai-Kuang
err分享
err收藏
err分享
err收藏
Molybdenum isotope ratios in Izu arc basalts: The control of subduction zone fluids on compositional variations in arc volcanic systems
err2020-11-01
err0
errOAAI
errJaviera Villalobos-Orchard; Heye Freymuth; Brian O'Driscoll; Tim Elliott; Helen Williams; Martina Casalini; Matthias Willbold
err分享
err收藏
学者 查看更多内容