返回
Monocular 3D object detection for construction scene analysis
DOI:10.1111/mice.13143.png)
摘要
En 中文
Three-dimensional (3D) object detection, that is, localizing and classifying all critical objects in a 3D space, is essential for downstream construction scene analysis tasks. However, accurate instance segmentation, few 2D object segmentation and 3D object detection data sets, high-quality feature representations for depth estimation, and limited 3D cues from a single red-green-blue (RGB) image pose significant challenges to 3D object detection and severely hinder its practical applications. In response to these challenges, an improved cascade-based network with a transformer backbone and a boundary-patch-refinement method is proposed to build hierarchical features and refine object boundaries, resulting in better results in 2D object detection and instance segmentation. Furthermore, a novel self-supervised monocular depth learning method is proposed to extract better feature representations for depth estimation from construction site video data with unknown camera parameters. Additionally, a pseudo-LiDAR point cloud method and a 3D object detection method with a density-based clustering algorithm are proposed to detect 3D objects in a construction scene without help from 3D labels, which will serve as a good foundation for other downstream 3D tasks. Finally, the proposed model is evaluated for object instance segmentation and depth estimation on the moving objects in construction sites (MOCS) and construction scene data sets. It brings a 9.16% gain in terms of mean average precision (mAP) for object detection and a 4.92% gain in mask mAP for object instance segmentation. The average order accuracy and relative mean error for depth estimation are improved by 0.94% and 60.56%, respectively. This study aims to overcome the challenges and limitations of 3D object detection and facilitate practical applications in construction scene analysis.
期刊
C
IF:
9.1
论文数:
2.0K
被引数:
10.0K
机构
暂无机构信息
引用论文
Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍?
SODA: A large-scale open site object detection dataset for deep learning in constructionSODA: 用于建筑深度学习的大规模开放站点对象检测数据集
Pressure-Based Bioassay Perceived by a Flexible Pressure Sensor with Synergistic Enhancement of the Photothermal Effect通过具有协同增强光热效应的柔性压力传感器感知的基于压力的生物测定

