arrow
返回

Global-Context-Aware Visual Odometry System With Epipolar-Geometry-Constrained Loss Function

delete2024-01-01
delete2
PRE
AI
冀中 封面图
冀中 (Zhong Ji)
K
Keqin Nan
徐岩 封面图
徐岩 (Yan Xu) *
H
Haoyuan Wang
X
Xuening Li
J
Jiale Bai
DOI:10.1109/TIM.2024.3370804delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Visual odometry (VO) plays a vital role in simultaneous localization and mapping (SLAM). Most of the current learning-based VO methods utilize convolutional neural network (CNN) as framework. However, CNN is weak in integrating global context information. In the design of loss function, the majority of these methods ignore the restraint relationship between translation and rotation prediction. In this work, we propose an end-to-end global-context-aware visual odometry with epipolar-geometry-constrained loss function (CEGVO) to estimate the relative 6-DoF poses of monocular camera. The proposed scheme designs an augmented-attention-enhanced global context block (GCB) on top of contextual CNN to learn the long-range dependencies and internal correlation. To overcome the problem of mutual restraint between the translation and rotation errors, an epipolar-geometry-constrained loss function is developed to simultaneously improve the prediction accuracy of both translation and rotation. The evaluation results on public datasets and self-collected dataset show that the proposed system outperforms the state-of-the-art (SOAT) learning-based VO methods with a large margin.
Keyword:
Deep learning
epipolar geometry
global context information
simultaneous localization and mapping (SLAM)
visual odometry (VO)

期刊

IEEE Transactions on Instrumentation and Measurement 封面图
IEEE Transactions on Instrumentation and Measurement
IF:
5.9
论文数:
2.0W
被引数:
5.8W

机构

T
tianjin university
学者数:
8.0W
论文数: 5.8W
被引数: 88
引用论文

引用论文

Dietary Menhaden Oil Contributes to Hepatic Lipidosis in Laying Hens
err1994-05-01
err0
errOAAI
errM.E. VAN ELSWYK; B.M. HARGIS; J.D. WILLIAMS; P.S. HARGIS
err分享
err收藏
err分享
err收藏
Transformer-Based Self-Supervised Monocular Depth and Visual Odometry
err2023-01-15
err6
PREAI
errZhao, Hongru; Qiao, Xiuquan; Ma, Yi; Tafazolli, Rahim
err分享
err收藏
A Robust RGB-D SLAM System With Points and Lines for Low Texture Indoor Environments
err2019-11-01
err56
PREAI
errFu, Qiang; Yu, Hongshan; Lai, Lihai; Wang, Jingwen; Peng, Xia; Sun, Wei; Sun, Mingui
err分享
err收藏
MRI findings in people with epilepsy and nodding syndrome in an area endemic for onchocerciasis: An observational study
err2013-09-05
err0
errOAAI
errAS Winkler; K Friedrich; S Velicheti; J Dharsee; R König; L Jilek-Aall; A Nassri; M Meindl; A Kidunda; TH Müller; W Matuja; T Gotwald; E Schmutzhard
err分享
err收藏
The N-terminal domain of the enzyme I is a monomeric well-folded protein with a low conformational stability and residual structure in the unfolded state
err2010-07-14
err0
errOAAI
errM. Romero-Beviar; S. Martinez-Rodriguez; J. Prieto; E. Goormaghtigh; U. Ariz; M. d. l. L. Martinez-Chantar; J. Gomez; J. L. Neira
err分享
err收藏
Circular dichroism studies of ampullosporin‐A analogues
err2003-11-05
err0
PREAI
errHoai‐Huong Nguyen; Diana Imhof; Matthias Kronen; Udo Gräfe; Siegmund Reissmann
err分享
err收藏
学者 查看更多内容