.png){kind=icon}
返回
Group Multi-View Transformer for 3D Shape Analysis With Spatial Encoding
.png){kind=icon}
OA
AI
DOI：10.1109/TMM.2024.3394731.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In recent years, the results of view-based 3D shape recognition methods have saturated, and models with excellent performance cannot be deployed on memory-limited devices due to their huge size of parameters. To address this problem, we introduce a compression method based on knowledge distillation for this field, which largely reduces the number of parameters while preserving model performance as much as possible. Specifically, to enhance the capabilities of smaller models, we design a high-performing large model called Group Multi-view Vision Transformer (GMViT). In GMViT, the view-level ViT first establishes relationships between view-level features. Additionally, to capture deeper features, we employ the grouping module to enhance view-level features into group-level features. Finally, the group-level ViT aggregates group-level features into complete, well-formed 3D shape descriptors. Notably, in both ViTs, we introduce spatial encoding of camera coordinates as innovative position embeddings. Furthermore, we propose two compressed versions based on GMViT, namely GMViT-simple and GMViT-mini. To enhance the training effectiveness of the small models, we introduce a knowledge distillation method throughout the GMViT process, where the key outputs of each GMViT component serve as distillation targets. Extensive experiments demonstrate the efficacy of the proposed method. The large model GMViT achieves excellent 3D classification and retrieval results on the benchmark datasets ModelNet, ShapeNetCore55, and MCB. The smaller models, GMViT-simple and GMViT-mini, reduce the parameter size by 8 and 17.6 times, respectively, and improve shape recognition speed by 1.5 times on average, while preserving at least 90% of the recognition performance.
Keyword:
Three-dimensional displays
Shape
Solid modeling
Feature extraction
Computational modeling
Aggregates
Long short term memory
3D object recognition
3D position embedding
knowledge distillation
multi-view ViT
view grouping
期刊
IF:
9.7
论文数:
4.7K
被引数:
2.4W
机构
引用论文
Extracorporeal Shockwave Therapy for Foot and Ankle Disorders: A Systematic Review and Meta-Analysis
PREAI
分享收藏分享收藏Deeply Exploiting Long-Term View Dependency for 3D Shape Recognition深度开发用于3D形状识别的长期视图依赖.png)
IEEE ACCESS
OAAI
IEEE ACCESSIF3.6
OAAI分享收藏
查看更多内容