arrow
Return

Global-Context-Aware Visual Odometry System With Epipolar-Geometry-Constrained Loss Function

delete2024-01-01
delete2
PRE
AI
冀中 cover
冀中 (Zhong Ji)
K
Keqin Nan
徐岩 cover
徐岩 (Yan Xu) *
H
Haoyuan Wang
X
Xuening Li
J
Jiale Bai
DOI:10.1109/TIM.2024.3370804delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Visual odometry (VO) plays a vital role in simultaneous localization and mapping (SLAM). Most of the current learning-based VO methods utilize convolutional neural network (CNN) as framework. However, CNN is weak in integrating global context information. In the design of loss function, the majority of these methods ignore the restraint relationship between translation and rotation prediction. In this work, we propose an end-to-end global-context-aware visual odometry with epipolar-geometry-constrained loss function (CEGVO) to estimate the relative 6-DoF poses of monocular camera. The proposed scheme designs an augmented-attention-enhanced global context block (GCB) on top of contextual CNN to learn the long-range dependencies and internal correlation. To overcome the problem of mutual restraint between the translation and rotation errors, an epipolar-geometry-constrained loss function is developed to simultaneously improve the prediction accuracy of both translation and rotation. The evaluation results on public datasets and self-collected dataset show that the proposed system outperforms the state-of-the-art (SOAT) learning-based VO methods with a large margin.
Keywords:
Deep learning
epipolar geometry
global context information
simultaneous localization and mapping (SLAM)
visual odometry (VO)

Journal

IEEE Transactions on Instrumentation and Measurement cover
IEEE Transactions on Instrumentation and Measurement
IF:
5.9
Papers:
1.9W
Citations:
5.8W

Organization

T
tianjin university
Scholars:
7.9W
Papers: 5.7W
Citations: 88