返回
Complementary pseudo multimodal feature for point cloud anomaly detection
DOI:10.1016/j.patcog.2024.110761.png)
摘要
En 中文
Point cloud anomaly detection is steadily emerging as a promising research area. Recognizing the importance of feature descriptiveness in this task, this study introduces the Complementary Pseudo Multimodal Feature (CPMF), which combines local geometrical information extracted by 3D handcrafted descriptors with global semantic information extracted from 2D pre-trained neural networks. Specifically, to leverage 2D pre-trained neural networks for point-wise feature extraction, this study projects original point clouds into multi-view images. These images are then fed into a pre-trained 2D neural network for informative 2D modality feature extraction. Following the 2D-3D correspondence, the multi-view 2D modality features are projected back to 3D space and aggregated to obtain point-wise 2D modality features. Finally, the point-wise 3D and 2D modality features are fused to derive the CPMF for point cloud anomaly detection. Extensive experiments conducted on MVTec 3D and Real3D datasets demonstrate the complementary capacity between 2D and 3D modality features and the effectiveness of CPMF. Notably, CPMF achieves a significantly higher objectlevel AUROC of 95.15% compared to other methods on the MVTec 3D benchmark. Code is available at https://github.com/caoyunkang/CPMF.
Keyword:
Point cloud
Anomaly detection
Pre-trained representation
Multimodal learning
Rendering
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
MV-ReID: 3D Multi-view Transformation Network for Occluded Person Re-IdentificationMv-reid: 用于遮挡人再识别的3D多视图转换网络
The MVTec Anomaly Detection Dataset: A Comprehensive Real-World Dataset for Unsupervised Anomaly DetectionMVTec异常检测数据集: 用于无监督异常检测的全面真实数据集
Deep open-set recognition for silicon wafer production monitoring用于硅片生产监控的深度开集识别
PATTERN RECOGNITION
IF7.6

