arrow
返回

Deep Confidence Propagation Stereo Network

delete2023-08-01
delete5
PRE
AI
K
Kai Zeng
王耀南 封面图
王耀南 (Yaonan Wang)
W
Wei Wang *
张辉 封面图
张辉 (Hui Zhang)
毛建旭 封面图
毛建旭 (Jianxu Mao)
Q
Qing Zhu
DOI:10.1109/TITS.2023.3264705delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Stereo matching depth estimation based on rectified image pairs is of great importance to many computer vision tasks such as vehicle navigation and autonomous driving. Confidence measures are typically used to refine stereo matching results, which provides robustness and efficiency for disparity estimation. However, previous learning-based confidence methods for stereo matching usually use the middle results or composition as a post-processing step to refine the stereo matching results. This cannot be optimized end-to-end and the performance is limited by the quality of the tri-modal output. To handle this issue, in this paper, we pursue an end-to-end hierarchical architecture and propose a differentiable confidence propagation (DCP) model of a cost aggregation network for stereo matching. The DCP model is integrated into an end-to-end neural network hierarchical architecture to guide matching cost volume aggregation. More specifically, to better represent the similarity of left and right feature maps, we extract unary context feature maps with an effective attention mechanism for matching cost construction. Moreover, we aggregate the cost volume with the multiple stacked DCP cost aggregation (DCPCA) networks to generate a more reliable and finer cost volume. This network suppresses multi-level disparity maps. Each output disparity is supervised with different training weights to learn in a coarse-to-fine way. Our method outperforms previous methods on the Sceneflow dataset by achieving the $0.6735px$ EPE error, achieving 1.53% D1-all metric of Non-occluded pixels regions and 0.72% Non-occluded pixels of $5px$ metric on KITTI 2015 and 2012 dataset. Extensive experiments carried out on the KITTI Stereo benchmarks demonstrate that our DCPCA-Net can significantly minimize the trade-off between accuracy and efficiency for stereo matching.
Keyword:
Costs
Feature extraction
Estimation
Correlation
Computer architecture
Measurement
Volume measurement
Stereo matching
confidence propagation
cost aggregation
unary feature maps

期刊

IEEE Transactions on Intelligent Transportation Systems 封面图
IEEE Transactions on Intelligent Transportation Systems
IF:
8.4
论文数:
9.5K
被引数:
6.3W

机构

H
hunan university
学者数:
4.5W
论文数: 3.3W
被引数: 70
引用论文

引用论文

Granulomatous lymphadenitis caused by Corynebacterium ovis
err1974-01-01
err0
PREAI
errJ.B. Blackwell; F.H. Smith; P.R. Joyce
err分享
err收藏
Loss of Cultural and Functional Diversity Associated With Birds Across the Urbanization Gradient in a Tropical City
err2021-05-28
err0
errOAAI
errFrancisco Valente-Neto; Fabio de Oliveira Roque; Carolina Ferreira Pauliquevis; Ademir Kleber Morbeck de Oliveira; Diogo B. Provete; Judit K. Szabo; Franco Leandro Souza
err分享
err收藏
Accurate Stereo Matching by Two-Step Energy Minimization
err2015-03-01
err149
PREAI
errMozerov, Mikhail G.; van de Weijer, Joost
err分享
err收藏
Rethinking Training Strategy in Stereo Matching
err2023-10-01
err25
PREAI
errRao, Zhibo; Dai, Yuchao; Shen, Zhelun; He, Renjie
err分享
err收藏
err分享
err收藏
Towards a contribution to sustainable management of a dairy supply chain
err2020-01-01
err0
errOAAI
errFelipe Ungarato Ferreira; Sabine Robra; Priscilla Cristina Cabral Ribeiro; Carlos Francisco Simões Gomes; José Adolfo de Almeida Neto; Luciano Brito Rodrigues
err分享
err收藏
The Influence of Deforestation on Land Surface Temperature—A Case Study of Perak and Kedah, Malaysia
err2020-06-11
err0
errOAAI
errWan Shafrina Wan Mohd Jaafar; Khairul Nizam Abdul Maulud; Aisyah Marliza Muhmad Kamarulzaman; Asif Raihan; Syarina Md Sah; Azizah Ahmad; Siti Nor Maizah Saad; Ahmad Tarmizi Mohd Azmi; Nur Khairun Ayuni Jusoh Syukri; Waseem Razzaq Khan
err分享
err收藏
Association of non-invasive hemodynamics with arterial stiffness in rheumatoid arthritis
err2018-03-21
err0
PREAI
errPanagiota Anyfanti; Areti Triantafyllou; Eugenia Gkaliagkousi; Nikolaos Koletsos; Spyros Aslanidis; Stella Douma
err分享
err收藏
学者 查看更多内容