arrow
Return

Metrics for Evaluating Feature-Based Mapping Performance

delete2017-02-01
delete19
PRE
AI
P
Pablo Artaza Barrios *
M
Martin Adams
K
Keith Yu Kit Leung
F
Felipe Inostroza
G
Ghayur Naqvi
M
Marcos E. Orchard
DOI:10.1109/TRO.2016.2627027delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In robotic mapping and simultaneous localization and mapping, the ability to assess the quality of estimated maps is crucial. While concepts exist for quantifying the error in the estimated trajectory of a robot, or a subset of the estimated feature locations, the difference between all current estimated and ground-truth features is rarely considered jointly. In contrast to many current methods, this paper analyzes metrics, which automatically evaluate maps based on their joint detection and description uncertainty. In the tracking literature, the optimal subpattern assignment (OSPA) metric provided a solution to the problem of assessing target tracking algorithms and has recently been applied to the assessment of robotic maps. Despite its advantages over other metrics, the OSPA metric can saturate to a limiting value irrespective of the cardinality errors and it penalizes missed detections and false alarms in an unequal manner. This paper therefore introduces the cardinalized optimal linear assignment (COLA) metric, as a complement to the OSPA metric, for feature map evaluation. Their combination is shown to provide a robust solution for the evaluation of map estimation errors in an intuitive manner.
Keywords:
Map metric
simultaneous localization and mapping
mobile robots
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Robotics cover
IEEE Transactions on Robotics
IF:
10.5
Papers:
3.3K
Citations:
2.8W

Organization

U
universidad de chile
Scholars:
2.1W
Papers: 1.4W
Citations: 18