arrow
Return

Visual Perception for Multiple Human-Robot Interaction From Motion Behavior

delete2020-06-01
delete13
PRE
AI
E
Emrah Benli *
Y
Yuichi Motai
J
John G. Rogers
DOI:10.1109/JSYST.2019.2958747delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Visual perception is an important component for human-robot interaction processes in robotic systems. Interaction between humans and robots depends on the reliability of the robotic vision systems. The variation of camera sensors and the capability of these sensors to detect many types of sensory inputs improve the visual perception. The analysis of activities, motions, skills, and behaviors of humans and robots have been addressed by utilizing the heat signatures of the human body. The human motion behavior is analyzed by body movement kinematics, and the trajectory of the target is used to identify the objects and the human target in the omnidirectional (O-D) thermal images. The process of human target identification and gesture recognition by traditional sensors have problem for multitarget scenarios since these sensors may not keep all targets in their narrow field of view (FOV) at the same time. O-D thermal view increases the robots' line-of-sights and ability to obtain better perception in the absence of light. The human target is informed of its position, surrounding objects and any other human targets in its proximity so that humans with limited vision or vision disability can be assisted to improve their ability in their environment. The proposed method helps to identify the human targets in a wide FOV and light independent conditions to assist the human target and improve the human-robot and robot-robot interactions. The experimental results show that the identification of the human targets is achieved with a high accuracy.
Keywords:
Kinematics
Robot sensing systems
Visual perception
Legged locomotion
Head
Command cognition
human motion analysis
multiple human targets
multiple robots
omnidirectional (O-D) camera
robotic perception
target identification
thermal vision
visual perception
walking behavior
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

I
IEEE Open Journal of Circuits and Systems
IF:
2.4
Papers:
4.5K
Citations:
387

Organization

G
Gumushane University
Scholars:
492
Papers: 571
Citations: 3
United States Department of Defense cover
United States Department of Defense
Scholars:
2.8W
Papers: 2.3W
Citations: 172
V
Virginia Commonwealth University
Scholars:
2.2W
Papers: 1.8W
Citations: 1.9W
researcher View more organizations