.png){kind=icon}
返回
Encoding Multiple Sensor Data for Robotic Learning Skills From Multimodal Demonstration
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2019.2945484.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Learning a task such as pushing something, where the constraints of both position and force have to be satisfied, is usually difficult for a collaborative robot. In this work, we propose a multimodal teaching-by-demonstration system which can enable the robot to perform this kind of tasks. The basic idea is to transfer the adaptation of multi-modal information from a human tutor to the robot by taking account of multiple sensor signals (i.e., motion trajectories, stiffness, and force profiles). The human tutor's stiffness is estimated based on the limb surface electromyography (EMG) signals obtained from the demonstration phase. The force profiles in Cartesian space are collected from a force/torque sensor mounted between the robot endpoint and the tool. Subsequently, the hidden semi-Markov model (HSMM) is used to encode the multiple signals in a unified manner. The correlations between position and the other three control variables (i.e., velocity, stiffness and force) are encoded with separate HSMM models. Based on the estimated parameters of the HSMM model, the Gaussian mixture regression (GMR) is then utilized to generate the expected control variables. The learned variables are further mapped into an impedance controller in the joint space through inverse kinematics for the reproduction of the task. Comparative tests have been conducted to verify the effectiveness of our approach on a Baxter robot.
Keyword:
Robotic control
stiffness and force adaptation
multimodal learning
physical human-robot interaction
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Learning and Reproduction of Gestures by Imitation An Approach Based on Hidden Markov Model and Gaussian Mixture Regression基于隐马尔可夫模型和高斯混合回归的手势模仿学习与再现方法
OAAI
OAAI分享收藏Robot teaching by teleoperation based on visual interaction and extreme learning machine.png)
NEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏Adaptive Neural Network Control of an Uncertain Robot With Full-State Constraints具有全状态约束的不确定机器人自适应神经网络控制
PREAI
分享收藏Effects of Electrode Materials on Charge Conduction Mechanisms of Memory Device Based on Natural Aloe VeraMRS Advances
MRS AdvancesIF0
PREAI
分享收藏Human robot cooperation with compliance adaptation along the motion trajectoryAUTONOMOUS ROBOTSOAAI
AUTONOMOUS ROBOTSIF4.3
OAAI分享收藏
查看更多内容