arrow
Return

Metrics for Evaluating Feature-Based Mapping Performance

delete2017-02-01
delete19
PRE
AI
P
Pablo Artaza Barrios *
M
Martin Adams
K
Keith Yu Kit Leung
F
Felipe Inostroza
G
Ghayur Naqvi
M
Marcos E. Orchard
DOI:10.1109/TRO.2016.2627027delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In robotic mapping and simultaneous localization and mapping, the ability to assess the quality of estimated maps is crucial. While concepts exist for quantifying the error in the estimated trajectory of a robot, or a subset of the estimated feature locations, the difference between all current estimated and ground-truth features is rarely considered jointly. In contrast to many current methods, this paper analyzes metrics, which automatically evaluate maps based on their joint detection and description uncertainty. In the tracking literature, the optimal subpattern assignment (OSPA) metric provided a solution to the problem of assessing target tracking algorithms and has recently been applied to the assessment of robotic maps. Despite its advantages over other metrics, the OSPA metric can saturate to a limiting value irrespective of the cardinality errors and it penalizes missed detections and false alarms in an unequal manner. This paper therefore introduces the cardinalized optimal linear assignment (COLA) metric, as a complement to the OSPA metric, for feature map evaluation. Their combination is shown to provide a robust solution for the evaluation of map estimation errors in an intuitive manner.
Keywords:
Map metric
simultaneous localization and mapping
mobile robots
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Robotics cover
IEEE Transactions on Robotics
IF:
10.5
Papers:
3.3K
Citations:
2.8W

Organization

U
universidad de chile
Scholars:
2.1W
Papers: 1.4W
Citations: 18
Cited Papers

Cited Papers

err
IF0
err
err0
PREAI
err
errShare
errSave
Prognostic Value of Grading Prostatic Carcinoma
err1963-06-01
err0
PREAI
errRex E. Wiederanders; Roscoe V. Stuber; Carlos Mota; Daniel O’Connell; George J. Haslam
errShare
errSave
Socioeconomic Position
err2000-03-09
err0
PREAI
errJohn Lynch; George Kaplan
errShare
errSave
Economic evaluations of educational, physical, and psychological treatments for fibromyalgia: a systematic review with meta-analysis
errPain
IF0
err2021-02-09
err0
errOAAI
errCristina Maria Nunes Cabral; Gisela Cristiane Miyamoto; Katherinne Ferro Moura Franco; Judith Ekkina Bosmans
errShare
errSave
Mediated Enzyme Electrodes with Combined Micro- and Nanoscale Supports
err2007-01-01
err0
PREAI
errScott Calabrese Barton; Yuhao Sun; Bhupesh Chandra; Sean White; James Hone
errShare
errSave
researcher View more