arrow
Return

Probabilistic Semantic Data Association for Collaborative Human-Robot Sensing

delete2023-08-01
delete2
delete
OA
AI
S
Shohei Wakayama
N
Nisar Ahmed *
DOI:10.1109/TRO.2023.3262111delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Humans cannot always be treated as oracles for collaborative sensing. Robots, thus, need to maintain beliefs over unknown world states when receiving semantic data from humans, as well as account for possible discrepancies between the human-provided data and these beliefs. To this end, this article introduces the problem of semantic data association (SDA) in relation to conventional data association problems for sensor fusion. It then develops a novel probabilistic semantic data association (PSDA) algorithm to rigorously address SDA in general settings, unlike previous work on semantic data fusion, which developed heuristic techniques for specific settings. PSDA is further incorporated into a recursive hybrid Bayesian data fusion scheme that uses Gaussian mixture priors for object states and softmax functions for semantic human sensor data likelihoods. Simulations of a multiobject search task show that PSDA enables robust collaborative state estimation under a wide range of conditions where semantic human sensor data can be erroneous or contain significant reference ambiguities.
Keywords:
Data association
human-robot interaction
multiobject search
semantic data fusion
state estimation

Journal

IEEE Transactions on Robotics cover
IEEE Transactions on Robotics
IF:
10.5
Papers:
3.3K
Citations:
2.8W

Organization

University of Colorado System cover
University of Colorado System
Scholars:
6.3W
Papers: 5.5W
Citations: 1.8K