arrow
Return

Learning-Based Multi-View Stereo: A Survey

delete2026-01-16
delete0
PRE
AI
F
Fangjinhua Wang
Q
Qingtian Zhu
D
Di Chang
Q
Quankai Gao
J
Junlin Han
T
Tong Zhang
R
Richard Hartley
M
Marc Pollefeys
DOI:10.1109/TPAMI.2026.3654665delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
3D reconstruction aims to recover the dense 3D structure of a scene. It plays an essential role in various applications such as Augmented/Virtual Reality (AR/VR), autonomous driving and robotics. Leveraging multiple views of a scene captured from different viewpoints, Multi-View Stereo (MVS) algorithms synthesize a comprehensive 3D representation, enabling precise reconstruction in complex environments. Due to its efficiency and effectiveness, MVS has become a pivotal method for image-based 3D reconstruction. Recently, with the success of deep learning, many learning-based MVS methods have been proposed, achieving impressive performance against traditional methods. We categorize these learning-based methods as: depth map-based, voxel-based, NeRF-based, 3D Gaussian Splatting-based, and large feed-forward methods. Among these, we focus significantly on depth map-based methods, which are the main family of MVS due to their conciseness, flexibility and scalability. In this survey, we provide a comprehensive review of the literature at the time of this writing. We investigate these learning-based methods, summarize their performances on popular benchmarks, and discuss promising future research directions in this area.
Keywords:
3D reconstruction
multi-view stereo
deep learning

Journal

IEEE Transactions on Pattern Analysis and Machine Intelligence cover
IEEE Transactions on Pattern Analysis and Machine Intelligence
IF:
18.6
Papers:
1.1K
Citations:
9.8W

Organization

A
australian national university
Scholars:
2.3K
Papers: 1.2K
Citations: 0
U
university of southern california
Scholars:
4.7W
Papers: 3.8W
Citations: 51
U
university of tokyo
Scholars:
6.4K
Papers: 2.5K
Citations: 1
U
University of Chinese Academy of Sciences
Scholars:
6.8K
Papers: 2.7K
Citations: 24.6W
E
eth zurich
Scholars:
2.3K
Papers: 1.1K
Citations: 0
U
university of oxford
Scholars:
9.8W
Papers: 8.6W
Citations: 137
researcher View more organizations
Cited Papers

Cited Papers

NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priors
err2022-11-11
err0
PREAI
errJiepeng Wang; Peng Wang; Xiaoxiao Long; Christian Theobalt; Taku Komura; Lingjie Liu; Wenping Wang
errShare
errSave
Emerging Properties in Self-Supervised Vision Transformers
err2021-10-01
err0
errOAAI
errMathilde Caron; Hugo Touvron; Ishan Misra; Herve Jegou; Julien Mairal; Piotr Bojanowski; Armand Joulin
errShare
errSave
U-Net: Convolutional Networks for Biomedical Image Segmentation
err2015-11-18
err0
PREAI
errOlaf Ronneberger; Philipp Fischer; Thomas Brox
errShare
errSave
Multiple View Geometry in Computer Vision
err
IF0
err2011-01-25
err0
PREAI
errRichard Hartley; Andrew Zisserman
errShare
errSave
SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse Views
err2022-11-11
err0
PREAI
errXiaoxiao Long; Cheng Lin; Peng Wang; Taku Komura; Wenping Wang
errShare
errSave
researcher View more