arrow
Return

Multi-Attention Network for Stereo Matching

delete2020-01-01
delete7
delete
OA
AI
X
Xiaowei Yang
L
Lin He *
赵勇 cover
赵勇 (Yong Zhao)
H
Haiwei Sang
Z
Zu Liu Yang
X
Xian Jing Cheng
DOI:10.1109/ACCESS.2020.3003375delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In recent years, convolutional neural network (CNN) algorithms promote the development of stereo matching and make great progress, but some mismatches still occur in textureless, occluded and reflective regions. In feature extraction and cost aggregation, CNNs will greatly improve the accuracy of stereo matching by utilizing global context information and high-quality feature representations. In this paper, we design a novel end-to-end stereo matching algorithm named Multi-Attention Network (MAN). To obtain the global context information in detail at the pixel-level, we propose a Multi-Scale Attention Module (MSAM), combining a spatial pyramid module with an attention mechanism, when we extract the image features. In addition, we introduce a feature refinement module (FRM) and a 3D attention aggregation module (3D AAM) during cost aggregation so that the network can extract informative features with high representational ability and high-quality channel attention vectors. Finally, we obtain the final disparity through bilinear interpolation and disparity regression. We evaluate our method on the Scene Flow, KITTI 2012 and KITTI 2015 stereo datasets. The experimental results show that our method achieves state-of-the-art performance and that every component of our network is effective.
Keywords:
Feature extraction
Three-dimensional displays
Convolution
Data mining
Image edge detection
Convolutional neural networks
Neural network
stereo matching
multi-scale attention module
feature refinement module
3D attention aggregation module
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

G
guizhou university
Scholars:
2.4W
Papers: 1.3W
Citations: 15
G
Guizhou Education University
Scholars:
698
Papers: 652
Citations: 6
P
peking university
Scholars:
11.8W
Papers: 8.7W
Citations: 146
researcher View more organizations