arrow
Return

A Low-Latency Framework With Algorithm-Hardware Co-Optimization for 3-D Point Cloud

delete2023-11-01
delete3
PRE
AI
Y
Yue Yu
W
Wendong Mao
J
Jiapeng Luo
Z
Zhongfeng Wang *
DOI:10.1109/TCSII.2023.3283142delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
An an important type of 3D representation, the point cloud is widely used in many applications, such as autonomous driving, AR/VR, and intelligent robots, which require real-time interactions with humans. However, the sparsity of 3D point cloud data leads to severe computational inefficiency when being processed by 2D data processors, posing a huge challenge for hardware acceleration. In this brief, we aim at solving the inefficiency problem by algorithm-hardware co-optimization. Firstly, a lightweight network, named LPN, is proposed for point cloud data classification, which is 30x smaller than pointnet and still has comparable accuracy. Secondly, a reconfigurable computing core, named RCC, together with an adaptive dataflow, is developed to support different layers of the LPN. Specifically, to accelerate memory-intensive layers, a partially-parallel computing scheme is introduced to minimize the on-chip memory requirements and DRAM accesses. Finally, based on the above innovations, a low-latency accelerator is proposed to realize real-time computation for the point cloud, which is implemented on the Xilinx Kintex UltraScale KCU150 FPGA board. Experimental results show that it achieves 1.5x throughput improvement compared with the state-of-the-art works, and 35x speedup over Intel Xeon Gold 6148 CPU, demonstrating the superiority of the proposed method. The code of LPN is available from https://github.com/snowsil/LPN-model-for-3D-classifification.
Keywords:
Point cloud
lightweight network
hardware design
low-latency
FPGA

Journal

I
IEEE Transactions on Circuits and Systems and Express Briefs
IF:
4.9
Papers:
8.8K
Citations:
2.5W

Organization

N
nanjing university
Scholars:
7.8W
Papers: 5.6W
Citations: 87
Cited Papers

Cited Papers

MVPN: Multi-View Prototype Network for 3D Shape Recognition
err2019-01-01
err3
errOAAI
errWu, Zizhao; Yang, Ping; Wang, Yigang
errShare
errSave
errShare
errSave
Frequent overexpression of epidermal growth factor receptor (EGFR) in mammary high grade ductal carcinomas with myoepithelial differentiation
err2005-11-25
err0
errOAAI
errT Shien; T Tashiro; M Omatsu; T Masuda; K Furuta; N Sato; S Akashi-Tanaka; M Uehara; E Iwamoto; T Kinoshita; T Fukutomi; H Tsuda; T Hasegawa
errShare
errSave
Assessment of antiviral activity and mechanism of rhein on newcastle disease virus (La Sota strain IV) in vitro
err2021-02-02
err0
PREAI
errYanchun Hu; Samuel Kumi Okyere; Ruiguang Xu; Guangneng Peng; Zhihua Ren; Junliang Deng; Yan Jia
errShare
errSave
Dose-dependent kinetics for theophylline: Observations among ambulatory asthmatic children
err1980-11-01
err0
PREAI
errEdward Sarrazin; Leslie Hendeles; Miles Weinberger; Keith Muir; Sidney Riegelman
errShare
errSave
Interfacial Water Regulation for Nitrate Electroreduction to Ammonia at Ultralow Overpotentials
err2025-01-08
err10
PREAI
errWan, YC; Pei, MJ; Tang, YX; Liu, Y; Yan, W; Zhang, JJ; Lv, RT
errShare
errSave
researcher View more