arrow
Return

A Point Cloud Video Recognition Acceleration Framework Based on Tempo-Spatial Information

delete2023-12-01
delete0
PRE
AI
S
Song, Zhuoran
W
Wanzhen Liu
T
Tao Yang
F
Fangxin Liu
N
Naifeng Jing *
梁晓峣 (Xiaoyao Liang)
DOI:10.1109/TPDS.2023.3323263delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In point cloud video recognition (PVR) tasks, deep neural networks (DNNs) have been widely adopted to enhance accuracy. However, real-time processing is hindered due to the increasing volume of points and frames that require processes. Point clouds represent 3D-shaped discrete objects using a multitude of points. Consequently, these points often exhibit an uneven distribution in the view space, resulting in strong spatial similarity within each point cloud frame. Taking advantage of this observation, this article introduces PRADA, a Point Cloud Recognition Acceleration algorithm via Dynamic Approximation. PRADA approximates and eliminates the similar local pairs' computations and recovers their results by copying dissimilar local pairs' features for speedup with negligible accuracy loss. Furthermore, considering the slow changes in point cloud frames that lead to the high temporal similarity among points across multiple frames, we design PointV, a Point Cloud Video Recognition Acceleration algorithm, to minimize unnecessary computations of similar points in the temporal domain. Moreover, we propose the PRADA and PointV architectures to accelerate the PRADA and PointV algorithms. These two architectures can be integrated to gain higher performance improvement. Our experiments on a wide variety of datasets show that PRADA averagely achieves about 7 x speedup over 1080TI GPU. In addition, the experimental results show that the PointV architecture and the integrated architecture can respectively achieve 11.7x and 13.9x performance improvement with acceptable accuracy compared to the 1080TI GPU.
Keywords:
Point cloud compression
Task analysis
Heuristic algorithms
Streaming media
Computer architecture
Approximation algorithms
Artificial neural networks
Point cloud video recognition task
deep neural network
acceleration
tempo-spatial information
accelerator

Journal

IEEE Transactions on Parallel and Distributed Systems cover
IEEE Transactions on Parallel and Distributed Systems
IF:
6
Papers:
5.2K
Citations:
1.1W

Organization

H
huawei technologies
Scholars:
3.3K
Papers: 2.9K
Citations: 1
S
shanghai jiao tong university
Scholars:
15.6W
Papers: 11.6W
Citations: 159