arrow
返回

A Light Multi-View Stereo Method with Patch-Uncertainty Awareness

delete2024-02-17
delete0
delete
OA
AI
Z
Zhen Liu
G
Guangzheng Wu
T
Tao Xie
S
Shilong Li
C
Chao Wu
Z
Zhiming Zhang
J
Jiali Zhou *
DOI:10.3390/s24041293delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Multi-view stereo methods utilize image sequences from different views to generate a 3D point cloud model of the scene. However, existing approaches often overlook coarse-stage features, impacting the final reconstruction accuracy. Moreover, using a fixed range for all the pixels during inverse depth sampling can adversely affect depth estimation. To address these challenges, we present a novel learning-based multi-view stereo method incorporating attention mechanisms and an adaptive depth sampling strategy. Firstly, we propose a lightweight, coarse-feature-enhanced feature pyramid network in the feature extraction stage, augmented by a coarse-feature-enhanced module. This module integrates features with channel and spatial attention, enriching the contextual features that are crucial for the initial depth estimation. Secondly, we introduce a novel patch-uncertainty-based depth sampling strategy for depth refinement, dynamically configuring depth sampling ranges within the GRU-based optimization process. Furthermore, we incorporate an edge detection operator to extract edge features from the reference image's feature map. These edge features are additionally integrated into the iterative cost volume construction, enhancing the reconstruction accuracy. Lastly, our method is rigorously evaluated on the DTU and Tanks and Temples benchmark datasets, revealing its low GPU memory consumption and competitive reconstruction quality compared to other learning-based MVS methods.
Keyword:
multi-view stereo
attention mechanism
cost volume
depth learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Sensors 封面图
Sensors
IF:
3.5
论文数:
7.2W
被引数:
20.9W

机构

Z
zhejiang university of technology
学者数:
3.3W
论文数: 2.0W
被引数: 22
引用论文

引用论文

err分享
err收藏
Angiotensin-I Converting Enzyme Inhibition and Antioxidant Activity of Papain-Hydrolyzed Camel Whey Protein and Its Hepato-Renal Protective Effects in Thioacetamide-Induced Toxicity
err2021-02-20
err0
errOAAI
errAli Osman; Abdalla El-Hadary; Aida A. Korish; Haifa M. AlNafea; Manan A. Alhakbany; Awad A. Awad; Mahmoud Abdel-Hamid
err分享
err收藏
err分享
err收藏
Large-Scale Data for Multiple-View Stereopsis
err2016-04-23
err379
errOAAI
errAanaes, Henrik; Jensen, Rasmus Ramsbol; Vogiatzis, George; Tola, Engin; Dahl, Anders Bjorholm
err分享
err收藏
c slip in Ti3Al
err2006-08-20
err0
PREAI
errM. Thomas; A. Vassel; P. Veyssière
err分享
err收藏
Vis-MVSNet: Visibility-Aware Multi-view Stereo Network
err2022-10-14
err46
PREAI
errZhang, Jingyang; Li, Shiwei; Luo, Zixin; Fang, Tian; Yao, Yao
err分享
err收藏
Depression, Anxiety and Stress Among Indians in Times of Covid-19 Lockdown
err2020-06-23
err0
errOAAI
errUsama Rehman; Mohammad G. Shahnawaz; Neda H. Khan; Korsi D. Kharshiing; Masrat Khursheed; Kaveri Gupta; Drishti Kashyap; Ritika Uniyal
err分享
err收藏
err分享
err收藏
学者 查看更多内容