arrow
返回

Self-Supervised Deep Visual Odometry Based on Geometric Attention Model

delete2023-03-01
delete5
PRE
AI
J
Jiajia Dai
X
Xiaoxi Gong
Y
Yida Li
王俊 封面图
王俊 (Jun Wang) *
魏
魏明强 (Mingqiang Wei)
DOI:10.1109/TITS.2022.3227917delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Existing learning-based algorithms have a certain potential in visual odometry. In this work, we propose the solution of the learning-based method, which contains the attention mechanism and pose graph optimization. We set a self-supervised network as our backbone to cope with image data and error-heavy estimation pose for pose correction The pre-processing camera poses involved in the network can provide prior information. Combining the advantages of the abundant feature information and efficient attention mechanism, we design a geometric attention module that is sensitive to geometrical structure from images to accurately regress the rotation matrix. Then we improve the loss function with the weights of the attention module to consider the diversity of the data. Experimental results demonstrate the effectiveness and reliability of our approach on the public datasets KITTI with monocular task and stereo task. In comparison, the proposed method is superior to the existing methods in the translation component. In the self-supervised network, learning an attention mechanism can extract an effective connect relation of feature maps. We conduct ablation experiments under the self-supervised network backbone setting different strategies, and conclude that the proposed attention module is applicable to various sequences, and provide loss function improvements on the visual odometry task.
Keyword:
Visual odometry
self-supervised learning
attention mechanism
pose graph optimization

期刊

IEEE Transactions on Intelligent Transportation Systems 封面图
IEEE Transactions on Intelligent Transportation Systems
IF:
8.4
论文数:
9.7K
被引数:
6.3W

机构

暂无机构信息
引用论文

引用论文

Dietary Menhaden Oil Contributes to Hepatic Lipidosis in Laying Hens
err1994-05-01
err0
errOAAI
errM.E. VAN ELSWYK; B.M. HARGIS; J.D. WILLIAMS; P.S. HARGIS
err分享
err收藏
Isolation and experimental infection with Vibrio alginolyticus in the sea horse, Hippocampus reidi Ginsburg, 1933 (Osteichthyes: Syngnathidae) in Brazil
err2010-02-01
err0
errOAAI
errML. Martins; JLP. Mouriño; GF. Fezer; CC. Buglione Neto; P. Garcia; BC. Silva; A. Jatobá; FN. Vieira
err分享
err收藏
Ontop-spatial: Ontop of geospatial databases
err2019-10-01
err0
PREAI
errKonstantina Bereta; Guohui Xiao; Manolis Koubarakis
err分享
err收藏
err分享
err收藏
Evaluation of qualitative and quantitative data of Y-90 imaging in SPECT/CT and PET/CT phantom studies
err2021-02-10
err0
errOAAI
errAgata Kubik; Anna Budzyńska; Krzysztof Kacperski; Maciej Maciak; Michał Kuć; Piotr Piasecki; Maciej Wiliński; Marcin Konior; Mirosław Dziuk; Edward Iller
err分享
err收藏
err分享
err收藏
学者 查看更多内容