返回
T3DNet: Compressing Point Cloud Models for Lightweight 3-D Recognition
DOI:10.1109/TCYB.2024.3487220.png)
摘要
En 中文
The 3-D point cloud has been widely used in many mobile application scenarios, including autonomous driving and 3-D sensing on mobile devices. However, existing 3-D point cloud models tend to be large and cumbersome, making them hard to deploy on edged devices due to their high memory requirements and nonreal-time latency. There has been a lack of research on how to compress 3-D point cloud models into lightweight models. In this article, we propose a method called T3DNet (tiny 3-D network with augmentation and distillation) to address this issue. We find that the tiny model after network augmentation is much easier for a teacher to distill. Instead of gradually reducing the parameters through techniques, such as pruning or quantization, we predefine a tiny model and improve its performance through auxiliary supervision from augmented networks and the original model. We evaluate our method on several public datasets, including ModelNet40, ShapeNet, and ScanObjectNN. Our method can achieve high compression rates without significant accuracy sacrifice, achieving state-of-the-art performances on three datasets against existing methods. Amazingly, our T3DNet is 58 x smaller and 54 x faster than the original model yet with only 1.4 % accuracy descent on the ModelNet40 dataset. Our code is available at https://github.com/Zhiyuan002/T3DNet.
Keyword:
Solid modeling
Point cloud compression
Three-dimensional displays
Computational modeling
Accuracy
Sensors
Feature extraction
Quantization (signal)
Knowledge engineering
Image coding
3-D model compression
knowledge distillation (KD)
network augmentation
point cloud models
期刊
IF:
10.5
论文数:
1.1W
被引数:
5.0W
机构
引用论文
Specific Expert Learning: Enriching Ensemble Diversity via Knowledge Distillation特定的专家学习: 通过知识蒸馏丰富整体多样性

