arrow
返回

Vision-Based Learning from Demonstration System for Robot Arms

delete2022-03-31
delete8
delete
OA
AI
P
Pin-Jui Hwang
C
Chen‐Chien Hsu *
P
Po‐Yung Chou
W
Wei‐Yen Wang
C
Cheng-Hung Lin
DOI:10.3390/s22072678delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Robotic arms have been widely used in various industries and have the advantages of cost savings, high productivity, and efficiency. Although robotic arms are good at increasing efficiency in repetitive tasks, they still need to be re-programmed and optimized when new tasks are to be deployed, resulting in detrimental downtime and high cost. It is therefore the objective of this paper to present a learning from demonstration (LfD) robotic system to provide a more intuitive way for robots to efficiently perform tasks through learning from human demonstration on the basis of two major components: understanding through human demonstration and reproduction by robot arm. To understand human demonstration, we propose a vision-based spatial-temporal action detection method to detect human actions that focuses on meticulous hand movement in real time to establish an action base. An object trajectory inductive method is then proposed to obtain a key path for objects manipulated by the human through multiple demonstrations. In robot reproduction, we integrate the sequence of actions in the action base and the key path derived by the object trajectory inductive method for motion planning to reproduce the task demonstrated by the human user. Because of the capability of learning from demonstration, the robot can reproduce the tasks that the human demonstrated with the help of vision sensors in unseen contexts.
Keyword:
learning from demonstration
action recognition
robotics
robotic arms
object detection
trajectory planning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Sensors 封面图
Sensors
IF:
3.5
论文数:
7.2W
被引数:
20.9W

机构

N
National Taiwan Normal University
学者数:
4.8K
论文数: 4.7K
被引数: 4.4K
引用论文

引用论文

Learning-Based Kinematic Control Using Position and Velocity Errors for Robot Trajectory Tracking
err2022-02-01
err16
PREAI
errXu, Sheng; Ou, Yongsheng; Wang, Zhiyang; Duan, Jianghua; Li, Hao
err分享
err收藏
Abnormal Activity Recognition from Surveillance Videos Using Convolutional Neural Network
errSENSORS
IF3.5
err2021-12-11
err24
errOAAI
errHabib, Shabana; Hussain, Altaf; Albattah, Waleed; Islam, Muhammad; Khan, Sheroz; Khan, Rehan Ullah; Khan, Khalil
err分享
err收藏
err分享
err收藏
Increasing Teachers’ Knowledge About ADHD and Learning Disorders
err2012-07-30
err0
PREAI
errAna P. Aguiar; Renata R. Kieling; Adriana C. Costa; Neusa Chardosim; Beatriz V. Dorneles; Mariana R. Almeida; Ana C. Mazzuca; Christian Kieling; Luis A. Rohde
err分享
err收藏
Keyframe-based Learning from Demonstration Method and Evaluation
err2012-06-28
err158
PREAI
errAkgun, Baris; Cakmak, Maya; Jiang, Karl; Thomaz, Andrea L.
err分享
err收藏
Detection of proliferative responses to ESAT-6 and CFP-10 by FASCIA assay for diagnosis of Mycobacterium tuberculosis infection通过筋膜试验检测对ESAT-6和CFP-10的增殖反应以诊断结核分枝杆菌感染
err2011-07-01
err0
PREAI
errEmilie Borgström; Peter Andersen; Lena Andersson; Inger Julander; Gunilla Källenius; Markus Maeurer; Maria Norrby; Ida Rosenkrands; Teghesti Tecleab; Judith Bruchfeld; Hans Gaines
err分享
err收藏
A new general method for protection of the hydroxyl function
err1976-03-01
err0
PREAI
errE.J. Corey; Jean-Louis Gras; Peter Ulrich
err分享
err收藏
学者 查看更多内容