arrow
Return

Interactive object recognition using proprioceptive and auditory feedback

delete2011-08-01
delete51
PRE
AI
J
Jivko Sinapov *
U
Ugonna Ohiri
S
Shane Griffith
A
Alexander Stoytchev
DOI:10.1177/0278364911408368delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper we propose a method for interactive recognition of household objects using proprioceptive and auditory feedback. In our experiments, the robot observed the changes in its proprioceptive and auditory sensory streams while performing five exploratory behaviors (lift, shake, drop, crush, and push) on 50 common household objects (e.g. bottles, cups, balls, toys, etc.). The robot was tasked with recognizing the objects it was manipulating by feeling them and listening to the sounds that they make without using any visual information. The results show that both proprioception and audio, coupled with exploratory behaviors, can be used successfully for object recognition. Furthermore, the robot was able to integrate feedback from the two modalities, to achieve even better recognition accuracy. Finally, the results show that the robot can boost its recognition rate even further by applying multiple different exploratory behaviors on the object.
Keywords:
Developmental robotics
behavior-based systems
exploratory behaviors
interactive object recognition
multimodal object recognition
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

International Journal of Robotics Research cover
International Journal of Robotics Research
IF:
5
Papers:
2.4K
Citations:
1.5W

Organization

I
Iowa State University
Scholars:
2.1W
Papers: 1.8W
Citations: 2.5W