arrow
返回

MVSRF: Point cloud semantic segmentation and optimization method for granular construction objects

delete2025-02-04
delete0
PRE
AI
L
L. Zhang
J
Jiaqi Lu
C
Changxin Wang
DOI:10.1007/s10489-025-06326-3delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Identifying shapeless granular materials in complex construction scenarios is critical for achieving automation in engineering equipment such as wheel loaders. The challenges of segmenting point clouds for granular materials involve dealing with sparsity, real-time processing requirements, the lack of distinct shape representation, and the issue of different materials sharing similar shapes. This paper proposes MVSRF, a real-time multi-view based point cloud semantic segmentation method incorporating a single-frame re-segmentation component and a multi-frame semantic filter to enhance accuracy and robustness. First, the segmentation system generates a sparse pixel-depth grid map via semantic projection to encapsulate global points and their behaviors, while employing an edge detector to label boundary points around objects. Second, a zero-shot re-segmentation algorithm involving seed extension, novel one-dimensional DBSCAN, Delaunay triangulation, and semantic reassignment corrects mis-segmented points caused by mapping bias. Finally, a lightweight semantic filter is designed to suppress semantic noise during multiple observations. We have built a multi-sensor platform on a wheel loader and collected experimental data to verify the effectiveness of our method. Two optimization components illustrated exceptional performance on the annotated dataset. The MVSRF method possesses strong robustness against external calibration errors, camera pose estimation errors, and inaccurate image segmentation, providing a practical solution for real-time perception of granular materials.
Keyword:
Granular materials
Point cloud segmentation
Pixel-depth grid map
Single-frame re-segmentation
Multi-frame semantic filter

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.6K
被引数:
1.7W

机构

T
tongji university
学者数:
7.9W
论文数: 6.0W
被引数: 98
引用论文

引用论文

Structure from Motion Photogrammetry in Forestry: a Review林业运动摄影测量的结构: 综述
err2019-07-16
err381
errOAAI
errIglhaut, Jakob; Cabo, Carlos; Puliti, Stefano; Piermattei, Livia; O'Connor, James; Rosette, Jacqueline
err分享
err收藏
Multi-view stereo in the Deep Learning Era: A comprehensive revfiew
err2021-12-01
err73
PREAI
errWang, Xiang; Wang, Chen; Liu, Bing; Zhou, Xiaoqing; Zhang, Liang; Zheng, Jin; Bai, Xiao
err分享
err收藏
Automatic Instrument Segmentation in Robot-Assisted Surgery Using Deep Learning
err
IF0
err2018-03-03
err0
errOAAI
errAlexey A. Shvets; Alexander Rakhlin; Alexandr A. Kalinin; Vladimir I. Iglovikov
err分享
err收藏
Interstitial cystitis and ileus in pediatric-onset systemic lupus erythematosus
err2000-07-19
err0
PREAI
errHiroshi Tanaka; Shinobu Waga; Takashi Tateyama; Tohru Nakahata; Tatsuo Ito; Kazuhiko Sugimoto; Yoshiki Kakizaki; Kazuhiko Tomimoto; Masaru Yokoyama
err分享
err收藏
Effect of Developmental Binocular Vision Abnormalities on Visual Vertigo Symptoms and Treatment Outcome
err2015-10-01
err0
errOAAI
errMarousa Pavlou; James Acheson; Despina Nicolaou; Clare L. Fraser; Adolfo M. Bronstein; Rosalyn A. Davies
err分享
err收藏
学者 查看更多内容