返回
Self-Supervised Deep Visual Odometry Based on Geometric Attention Model
DOI:10.1109/TITS.2022.3227917.png)
摘要
En 中文
Existing learning-based algorithms have a certain potential in visual odometry. In this work, we propose the solution of the learning-based method, which contains the attention mechanism and pose graph optimization. We set a self-supervised network as our backbone to cope with image data and error-heavy estimation pose for pose correction The pre-processing camera poses involved in the network can provide prior information. Combining the advantages of the abundant feature information and efficient attention mechanism, we design a geometric attention module that is sensitive to geometrical structure from images to accurately regress the rotation matrix. Then we improve the loss function with the weights of the attention module to consider the diversity of the data. Experimental results demonstrate the effectiveness and reliability of our approach on the public datasets KITTI with monocular task and stereo task. In comparison, the proposed method is superior to the existing methods in the translation component. In the self-supervised network, learning an attention mechanism can extract an effective connect relation of feature maps. We conduct ablation experiments under the self-supervised network backbone setting different strategies, and conclude that the proposed attention module is applicable to various sequences, and provide loss function improvements on the visual odometry task.
Keyword:
Visual odometry
self-supervised learning
attention mechanism
pose graph optimization
期刊
IF:
8.4
论文数:
9.7K
被引数:
6.3W
机构
暂无机构信息
引用论文
Perovskite solid electrolytes: Structure, transport properties and fuel cell applications钙钛矿固体电解质: 结构、输运性质和燃料电池应用
Evaluation of qualitative and quantitative data of Y-90 imaging in SPECT/CT and PET/CT phantom studies
PLOS ONE
IF0

