arrow
返回

Object SLAM Based on Spatial Layout and Semantic Consistency

delete2023-01-01
delete2
PRE
AI
X
Xingwu Ji
P
Peilin Liu *
H
Haochen Niu
X
Xiang Chen
R
Rendong Ying
F
Fei Wen
DOI:10.1109/TIM.2023.3316258delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Visual simultaneous localization and mapping (SLAM) systems face challenges in detecting loop closure under the circumstance of large viewpoint changes. In this article, we present an object-level SLAM system based on the spatial layout and semantic consistency of the 3-D scene graph. Firstly, we propose an object-level data association approach based on the semantic information from semantic labels, intersection over union (IoU), object color, and object embedding. Subsequently, multi-view bundle adjustment (BA) with the associated objects is utilized to jointly optimize the poses of objects and cameras. We represent the refined objects as a 3-D spatial graph with semantics and topology. Then, we propose a graph matching approach to find corresponding objects based on the spatial layout and semantic property similarity of vertices' neighbors. Finally, we jointly optimize camera trajectories and object poses in an object-level pose graph optimization, which results in a globally consistent map. Experimental results demonstrate that our proposed data association approach can construct more accurate 3-D semantic maps, and our loop closure method is more robust than point-based and object-based methods in circumstances with large viewpoint changes.
Keyword:
Location awareness
Loop closure detection
semantic mapping
visual simultaneous localization and mapping (SLAM)

期刊

IEEE Transactions on Instrumentation and Measurement 封面图
IEEE Transactions on Instrumentation and Measurement
IF:
5.9
论文数:
2.0W
被引数:
5.8W

机构

S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
引用论文

引用论文

A novel endoesophageal magnetic device to prevent gastroesophageal reflux
err2008-12-31
err0
PREAI
errMauro Bortolotti; Annamaria Grandis; Giosuè Mazzero
err分享
err收藏
APPLE DAMAGE AND COMPRESSIVE FORCES IN BULK BINS DURING ORCHARD TRANSPORT
err1998-01-01
err0
PREAI
errE. J. Timm; A. F. Bollen; B. T. Dela Rue; I. M. Woodhead
err分享
err收藏
err分享
err收藏
Proteinase-Activated Receptor 2 Mediates Thermal Hyperalgesia and Is Upregulated in a Rat Model of Chronic Pancreatitis
err2011-03-01
err0
PREAI
errWei Zhang; Jun Gao; Tao Zhao; Lei Wei; Wenbin Wu; Yu Bai; Duowu Zou; Zhaoshen Li
err分享
err收藏
The HERPET study: Imaging HER2 expression in breast cancer with the novel PET tracer [18F]GE-226, a first-in-patient study.
err2022-06-01
err0
PREAI
errLaura M. Kenny; Fiona J Gilbert; Gosala Gopalakrishnan; Preetha Aravind; Tara Barwick; Neva Patel; Duncan ROBERT Hiscock; Istvan Boros; Steven Kealey; Franklin I Aigbirhio; Jingky Lozano-kuehne; Susan Jane Cleator; Ben Fleming; Pippa Riddle; Rizvana Ahmad; Sue Chua; Stephen R.D. Johnston; Janine Mansi; Gary J. Cook; Eric O. Aboagye
err分享
err收藏
High ozone levels in the northeast of Portugal: Analysis and characterization
err2010-03-01
err0
PREAI
errA. Carvalho; A. Monteiro; I. Ribeiro; O. Tchepel; A.I. Miranda; C. Borrego; S. Saavedra; J.A. Souto; J.J. Casares
err分享
err收藏
err分享
err收藏
学者 查看更多内容