返回
Resource-Efficient Visual Multiobject Tracking on Embedded Device
DOI:10.1109/JIOT.2021.3115102.png)
摘要
En 中文
Multiobject tracking (MOT) is a crucial technology for security surveillance, which is computationally intensive due to the requirement of processing a large number of video streams within low latency in practice. The input video streams of MOT are processed on a cloud computing center with abundant computational capability, posing heavy pressures on delivering video streams to the cloud. Recent advances in the Internet-of-Things (IoT) technology provide edge-computing-based solutions for video analytics at scale. However, the gap between MOT's high computational capability demand and IoT devices' resource-constrained nature remains significant. In this article, a resource-efficient MOT (REMOT) method is proposed for real-time surveillance on IoT embedded devices, including an affinity measurement based on an appearance model with angular triplet loss and a motion association that substitutes the time-consuming graph-based data association stage. Considering the tradeoff between latency and accuracy, we design an optimization strategy on the parallel processing of deep learning models' layers to accelerate the inference speed with less accuracy loss. Besides, we employ a model compression strategy for model size reduction. Experiments on MOT16 and MOT17 benchmarks demonstrate that REMOT reduces 2.4x latency compared with the original implementation and achieves a running speed of 81 frames per second (fps) on an embedded device with only a marginal accuracy loss (6 %), which meets the requirements of real-time processing and low-latency response for surveillance.
Keyword:
Appearance representation
deep learning
edge video analytics
Internet of Things (IoT)
multiobject tracking (MOT)
期刊
IF:
8.9
论文数:
1.4W
被引数:
7.8W
机构
引用论文
Modern Room Temperature Ionic Liquids, a Simple Guide to Understanding Their Structure and How It May Relate to Dynamics现代室温离子液体,了解其结构及其与动力学的简单指南

