arrow
返回

Monocular 3D object detection for construction scene analysis

delete2023-12-20
delete1
PRE
AI
J
Jie Shen *
L
Lang Jiao
C
Cong Zhang
DOI:10.1111/mice.13143delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Three-dimensional (3D) object detection, that is, localizing and classifying all critical objects in a 3D space, is essential for downstream construction scene analysis tasks. However, accurate instance segmentation, few 2D object segmentation and 3D object detection data sets, high-quality feature representations for depth estimation, and limited 3D cues from a single red-green-blue (RGB) image pose significant challenges to 3D object detection and severely hinder its practical applications. In response to these challenges, an improved cascade-based network with a transformer backbone and a boundary-patch-refinement method is proposed to build hierarchical features and refine object boundaries, resulting in better results in 2D object detection and instance segmentation. Furthermore, a novel self-supervised monocular depth learning method is proposed to extract better feature representations for depth estimation from construction site video data with unknown camera parameters. Additionally, a pseudo-LiDAR point cloud method and a 3D object detection method with a density-based clustering algorithm are proposed to detect 3D objects in a construction scene without help from 3D labels, which will serve as a good foundation for other downstream 3D tasks. Finally, the proposed model is evaluated for object instance segmentation and depth estimation on the moving objects in construction sites (MOCS) and construction scene data sets. It brings a 9.16% gain in terms of mean average precision (mAP) for object detection and a 4.92% gain in mask mAP for object instance segmentation. The average order accuracy and relative mean error for depth estimation are improved by 0.94% and 60.56%, respectively. This study aims to overcome the challenges and limitations of 3D object detection and facilitate practical applications in construction scene analysis.

期刊

C
Computer-Aided Civil and Infrastructure Engineering
IF:
9.1
论文数:
2.0K
被引数:
10.0K

机构

暂无机构信息
引用论文

引用论文

Automatic far-field camera calibration for construction scene analysis
err2021-02-26
err16
errOAAI
errAssadzadeh, Amin; Arashpour, Mehrdad; Bab-Hadiashar, Alireza; Ngo, Tuan; Li, Heng
err分享
err收藏
Improvement of small objects detection in thermal images热图像中小物体检测方法的改进
err2023-08-31
err7
errOAAI
errChaverot, Maxence; Carre, Maxime; Jourlin, Michel; Bensrhair, Abdelaziz; Grisel, Richard
err分享
err收藏
学者 查看更多内容