arrow
返回

Complementary pseudo multimodal feature for point cloud anomaly detection

delete2024-12-01
delete4
delete
OA
AI
曹云康 封面图
曹云康 (Yunkang Cao)
X
Xiaohao Xu
沈卫明 封面图
沈卫明 (Weiming Shen) *
DOI:10.1016/j.patcog.2024.110761delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Point cloud anomaly detection is steadily emerging as a promising research area. Recognizing the importance of feature descriptiveness in this task, this study introduces the Complementary Pseudo Multimodal Feature (CPMF), which combines local geometrical information extracted by 3D handcrafted descriptors with global semantic information extracted from 2D pre-trained neural networks. Specifically, to leverage 2D pre-trained neural networks for point-wise feature extraction, this study projects original point clouds into multi-view images. These images are then fed into a pre-trained 2D neural network for informative 2D modality feature extraction. Following the 2D-3D correspondence, the multi-view 2D modality features are projected back to 3D space and aggregated to obtain point-wise 2D modality features. Finally, the point-wise 3D and 2D modality features are fused to derive the CPMF for point cloud anomaly detection. Extensive experiments conducted on MVTec 3D and Real3D datasets demonstrate the complementary capacity between 2D and 3D modality features and the effectiveness of CPMF. Notably, CPMF achieves a significantly higher objectlevel AUROC of 95.15% compared to other methods on the MVTec 3D benchmark. Code is available at https://github.com/caoyunkang/CPMF.
Keyword:
Point cloud
Anomaly detection
Pre-trained representation
Multimodal learning
Rendering
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

U
university of michigan system
学者数:
9.1W
论文数: 8.6W
被引数: 133
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Deep open-set recognition for silicon wafer production monitoring用于硅片生产监控的深度开集识别
err2022-04-01
err19
errOAAI
errFrittoli, Luca; Carrera, Diego; Rossi, Beatrice; Fragneto, Pasqualina; Boracchi, Giacomo
err分享
err收藏
err分享
err收藏
A novel hybrid approach for crack detection
err2020-11-01
err105
PREAI
errFang, Fen; Li, Liyuan; Gu, Ying; Zhu, Hongyuan; Lim, Joo-Hwee
err分享
err收藏
A Comprehensive Survey on Graph Anomaly Detection With Deep Learning基于深度学习的图异常检测综述
err2023-12-01
err226
errOAAI
errMa, Xiaoxiao; Wu, Jia; Xue, Shan; Yang, Jian; Zhou, Chuan; Sheng, Quan Z.; Xiong, Hui; Akoglu, Leman
err分享
err收藏
Rotation invariant point cloud analysis: Where local geometry meets global topology
err2022-07-01
err30
PREAI
errZhao, Chen; Yang, Jiaqi; Xiong, Xin; Zhu, Angfan; Cao, Zhiguo; Li, Xin
err分享
err收藏
学者 查看更多内容