arrow
返回

Context-Aware 3D Point Cloud Semantic Segmentation With Plane Guidance

delete2023-01-01
delete6
PRE
AI
T
Tingyu Weng
J
Jun Xiao
F
Feilong Yan
姜
姜海勇 (Haiyong Jiang) *
DOI:10.1109/TMM.2022.3212914delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Point cloud segmentation is fundamental in understanding 3D environments. However, most existing methods usually perform poorly on identifying boundaries of touching objects and large surfaces of objects. Planes in a scene usually act as supporting surfaces to separate touching objects and provide geometry priors to group points on a large surface as shown in Fig. 1. Besides, planes can roughly represent the structure of a scene, and are more efficient to encode holistic scene contexts than large scale point clouds. In light of the above advantages, we advise a plane-assisted module, coined 3D-PAM, to enhance semantic segmentation of touching objects and large surface objects. 3D-PAM consists of a plane separation network (PS-Net) and a plane relation network (PR-Net). PS-Net focuses on learning features that can robustly separate touching objects, e.g., a chair on a floor, as well as capture plane-based geometry priors to group points on a large plane, e.g., points of a desk. PR-Net encodes mutual plane relations as a proxy of a scene structure to capture holistic contexts. 3D-PAM is designed as a plug-and-play module so that it can be easily plugged into any off-the-shelf semantic segmentation network. Extensive experiments demonstrate that the method achieves large segmentation improvements on several backbones, and accomplishes superior results on most categories when using a RandLA-Net backbone (11/13 categories on S3DIS dataset and 15/20 categories on ScanNetv2 dataset). The project is available at GitHub https://github.com/windmillknight/ Context- Aware- 3DPoint- Cloud- Semantic-Segmentation-With- Plane- Guidance
Keyword:
Three-dimensional displays
Point cloud compression
Geometry
Shape
Semantics
Task analysis
Network architecture
3D semantic segmentation
holistic contexts
point cloud
plane geometry

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.5K
被引数:
2.4W

机构

U
university of chinese academy of sciences, cas
学者数:
4.1W
论文数: 3.8W
被引数: 75
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

RAPTER: Rebuilding Man-made Scenes with Regular Arrangements of Planes
err2015-07-27
err104
errOAAI
errMonszpart, Aron; Mellado, Nicolas; Brostow, Gabriel J.; Mitra, Niloy J.
err分享
err收藏
Tumor-α9β1 integrin-mediated signaling induces breast cancer growth and lymphatic metastasis via the recruitment of cancer-associated fibroblasts
err2014-08-08
err0
PREAI
errDaichi Ota; Masashi Kanayama; Yutaka Matsui; Koyu Ito; Naoyoshi Maeda; Goro Kutomi; Koichi Hirata; Toshihiko Torigoe; Noriyuki Sato; Akinori Takaoka; Ann F. Chambers; Junko Morimoto; Toshimitsu Uede
err分享
err收藏
IoT Applications in Agriculture: A Systematic Literature Review
err2018-12-27
err0
PREAI
errRaquel Gómez-Chabla; Karina Real-Avilés; César Morán; Paola Grijalva; Tanya Recalde
err分享
err收藏
学者 查看更多内容