arrow
返回

Feature enhancement network for stereo matching

delete2023-02-01
delete5
PRE
AI
H
Hong Zhang
B
Baoli Sun
H
Haojie Li
X
Xinchen Ye
Z
Zhihui Wang *
DOI:10.1016/j.imavis.2022.104614delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
In general stereo matching methods, there are mainly two kinds of weaknesses: the interior of large objects with unclear texture; object boundaries and small objects. One of the reasons for the first case is the underuse of inter -feature and intra-feature contexts, leading to the lack of discriminability of feature representations. And the sec-ond case could be caused result from the loss of fine-grained structural information in the features. In this work, we present a novel stereo matching network to enhance the feature representations, which contains two prom-inent components: pyramid context enhancement module and cross-modal enhancement module. Pyramid con-text enhancement module first constructs multi-scale pyramid features to promote global representation, and then exploits the inter-feature and intra-feature contextual information to improve the discriminability of fea-tures. Cross-modal enhancement module proactively degrades features of RGB image and disparity map to im-plicitly extract structures, and fuses both structures to recover the modal consistent structural information of features. Moreover, we design a disparity weight loss function which can calculates the adaptive weight accord-ing to prediction error to balance the loss response. Extensive experiments demonstrate that our method boosts the performance, and achieves better results on five challenging datasets than other typical methods. Code is available at: https://github.com/csl1994/FENet. (c) 2023 Elsevier B.V. All rights reserved.
Keyword:
Stereo matching
Deep learning
Pyramid feature representation
Cross -modal fusion
Disparity weight loss

期刊

Image and Vision Computing 封面图
Image and Vision Computing
IF:
4.2
论文数:
4.1K
被引数:
6.7K

机构

D
Dalian University of Technology
学者数:
6.0W
论文数: 4.4W
被引数: 5.5W
引用论文

引用论文

Self-Monitoring of Blood Glucose in Type 2 Diabetes: Recent Studies
err2013-03-01
err0
errOAAI
errOliver Schnell; Hasan Alawi; Tadej Battelino; Antonio Ceriello; Peter Diem; Anne-Marie Felton; Wladyslaw Grzeszczak; Kari Harno; Peter Kempler; Ilhan Satman; Bruno Vergès
err分享
err收藏
Monocular contextual constraint for stereo matching with adaptive weights assignment
err2022-05-01
err7
PREAI
errZhang, Chenghao; Meng, Gaofeng; Su, Bing; Xiang, Shiming; Pan, Chunhong
err分享
err收藏
Presentation of frozen shoulder among diabetic and non-diabetic patients
err2014-12-01
err0
errOAAI
errMohammad Moin Uddin; Aminuddin A. Khan; Andrew J. Haig; Mohammad Kafil Uddin
err分享
err收藏
Edge supervision and multi-scale cost volume for stereo matching
err2022-01-01
err18
PREAI
errYang, Xiaowei; Feng, Zhiguo; Zhao, Yong; Zhang, Guiying; He, Lin
err分享
err收藏
Multi-frame stereo matching with edges, planes, and superpixels
err2019-11-01
err16
errOAAI
errXue, Tianfan; Owens, Andrew; Scharstein, Daniel; Goesele, Michael; Szeliski, Richard
err分享
err收藏
PMBANet: Progressive Multi-Branch Aggregation Network for Scene Depth Super-Resolution
err2020-01-01
err73
PREAI
errYe, Xinchen; Sun, Baoli; Wang, Zhihui; Yang, Jingyu; Xu, Rui; Li, Haojie; Li, Baopu
err分享
err收藏
err分享
err收藏
Ethanol reforming processes over ZnO-supported palladium catalysts: Effect of alloy formation
err2006-05-01
err0
PREAI
errAlbert Casanovas; Jordi Llorca; Narcís Homs; José Luis G. Fierro; Pilar Ramírez de la Piscina
err分享
err收藏
学者 查看更多内容