.png){kind=icon}
返回
Monocular Pseudo-LiDAR Point Cloud Extrapolation Based on Iterative Hybrid Rendering
.png){kind=icon}
PRE
AI
DOI：10.1109/TITS.2022.3226566.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Recently, a pseudo-LiDAR point cloud extrapolation algorithm equipped with stereo cameras has been introduced, bridging the gap between the expensive 3D sensor LiDAR and relatively cheap 2D sensor camera in autonomous driving. In this paper, we explore an approach to further bridge this gap using only a monocular camera and extrapolate a wide field of view 3D point cloud from a limited 2D view. However, this task is extremely challenging as it requires inferring the occluded contents in the scene. To this end, we propose a 'render-refine-iterate-fuse' framework that takes advantage of both image view synthesis and image inpainting techniques, guiding the neural network to learn the potential spatial distribution. In addition, we design a hybrid rendering scheme to ensure that the visible content moves in a geometrically correct manner and fills the pixels caused by occlusion. Benefitting from the proposed framework, our approach achieves significant improvements on the pseudo-LiDAR point cloud extrapolation task. The gap between LiDAR and cameras is further bridged, showing an economical and practical application in the environment perception module of autonomous driving. The experimental results evaluated on the KITTI dataset demonstrate that our approach achieves superior quantitative and qualitative performance.
Keyword:
Monocular
pseudo-LiDAR point cloud
iterative extrapolation
hybrid rendering
multiplane images
期刊
IF:
8.4
论文数:
9.7K
被引数:
6.3W
机构
引用论文
Oxidative phosphorylation in guinea pig mammary gland mitochondria during various functional states
.png){kind=icon}
PREAI
分享收藏
分享收藏An Ultra-Trace Analysis Technique for SF6 Using Gas Chromatography with Negative Ion Chemical Ionization Mass Spectrometry使用气相色谱-负离子化学电离质谱对SF6的超痕量分析技术
OAAI
OAAI分享收藏
查看更多内容