arrow
Return

SE-MD: a single-encoder multiple-decoder deep network for point cloud reconstruction from 2D images

delete2023-04-04
delete3
PRE
AI
A
Abdul Mueed Hafiz *
R
Rouf Ul Alam Bhat
S
Shabir A. Parah
M
M. Hassaballah
DOI:10.1007/s10044-023-01155-xdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
3D model reconstruction from single 2D RGB images is a challenging and actively researched computer vision task. Several techniques based on conventional network architectures have been proposed for the same. However, the body of research work is limited and there are some issues like using inefficient 3D representation formats, weak 3D model reconstruction backbones, inability to reconstruct dense point clouds, dependence of post-processing for reconstruction of dense point clouds and dependence on silhouettes in RGB images. In this paper, a new 2D RGB image to point cloud conversion technique is proposed, which improves the state-of-the-art in the field due to its efficient, robust and simple model by using the concept of parallelization in network architecture. It not only uses efficient and rich 3D representation of point clouds, but also uses a new robust point cloud reconstruction backbone to address the prevalent issues. This involves using a single-encoder multiple-decoder deep network architecture wherein each decoder reconstructs certain fixed viewpoints. This is followed by fusing all the viewpoints to reconstruct a dense point cloud. Various experiments are conducted to evaluate the proposed technique and to compare its performance with those of the state-of-the-arts and impressive gains in performance are demonstrated.
Keywords:
3D model reconstruction
3D shape reconstruction
2D images
Point clouds
ShapeNet
3D convolutional networks

Journal

Pattern Analysis and Applications cover
Pattern Analysis and Applications
IF:
2
Papers:
1.9K
Citations:
1.9K

Organization

U
University of Kashmir
Scholars:
2.7K
Papers: 1.8K
Citations: 2.4K
P
Prince Sattam Bin Abdulaziz University
Scholars:
6.8K
Papers: 8.8K
Citations: 9.9K