arrow
Return

Multiple View Stereo with quadtree-guided priors

delete2023-02-01
delete9
PRE
AI
S
Stathopoulou, Elisavet Konstantina *
R
Roberto Battisti
D
Dan Costin Cernea
G
Georgopoulos, Andreas
F
Fabio Remondino
DOI:10.1016/j.isprsjprs.2022.12.013delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Multi-View Stereo (MVS) algorithms rely on common photometric consistency measures and, therefore, in cases of low-textured surfaces tend to generate unreliable depth estimates or lack completeness due to matching ambiguities. Such textureless areas often imply dominant planar structures, typically occurring in man-made scenes. To support depth estimation in scenarios where challenging surfaces are present, we propose an extended PatchMatch pipeline using an adaptive accumulated matching cost calculation based on estimated prior plane hypotheses and the local textureness. Plane priors are detected in the object space and guided by quadtree structures in order to generate depth and normal hypothesis for every pixel, supporting, in this way, the propagation of more reliable depth estimates across the image. Experiments on the ETH3D high-resolution dataset and on custom real-world scenes demonstrate that our approach can favor the reconstruction of problematic regions by adding small complexity while preserving fine details in rich textured regions, achieving thus competitive results compared to state-of-the-art methods. The source code of the developed method is available at https://github.com/3DOM-FBK/openMVS.
Keywords:
Multi View Stereo (MVS)
PatchMatch
Depth estimation
3D reconstruction
Dense point cloud
Quadtree
Plane detection
RANSAC

Journal

ISPRS Journal of Photogrammetry and Remote Sensing cover
ISPRS Journal of Photogrammetry and Remote Sensing
IF:
12.2
Papers:
4.4K
Citations:
3.2W

Organization

N
National Technical University of Athens
Scholars:
9.6K
Papers: 9.5K
Citations: 8.2K
F
Fondazione Bruno Kessler
Scholars:
1.8K
Papers: 1.7K
Citations: 3.2K