arrow
返回

Task-Oriented Deep Reinforcement Learning for Robotic Skill Acquisition and Control

delete2021-02-01
delete33
PRE
AI
向国菲 封面图
向国菲 (Guofei Xiang)
J
Jianbo Su *
DOI:10.1109/TCYB.2019.2949596delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Reinforcement learning (RL) and imitation learning (IL), especially equipped with deep neural networks, have been widely studied for autonomous robotic skill acquisition and control tasks. However, these methods and their extensions require extensive environmental interactions during training, which greatly prevents them from being applied to real-world robots. To alleviate this problem, we present an efficient model-free off-policy actor-critic algorithm for robotic skill acquisition and continuous control, by fusing the task reward with a task-oriented guiding reward, which is formulated by leveraging few and imperfect expert demonstrations. In this framework, the agent can explore the environment more intentionally, thus sampling efficiency can be achieved; moreover, the agent can also exploit the experience more effectively, thereby substantially improved performance can be realized simultaneously. The empirical results on robotic locomotion tasks show that the proposed scheme can lower sample complexity by 2-10 times in contrast with the state-of-the-art baseline deep RL (DRL) algorithms, while achieving performance better than that of the expert. Furthermore, the proposed algorithm achieves significant improvement in both sampling efficiency and asymptotic performance on tasks with sparse and delayed reward, wherein those baseline DRL algorithms struggle to make progress. This takes a substantial step forward to implement these methods to acquire skills autonomously for real robots.
Keyword:
Continuous control
deep neural networks (DNNs)
exploration
imitation learning (IL)
reinforcement learning (RL)
robotics
skill acquisition
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Cybernetics 封面图
IEEE Transactions on Cybernetics
IF:
10.5
论文数:
1.1W
被引数:
5.0W

机构

S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
引用论文

引用论文

Learning agile and dynamic motor skills for legged robots
err2019-01-30
err795
errOAAI
errHwangbo, Jemin; Lee, Joonho; Dosovitskiy, Alexey; Bellicoso, Dario; Tsounis, Vassilios; Koltun, Vladlen; Hutter, Marco
err分享
err收藏
Uncoupling protein-2 polymorphisms in type 2 diabetes, obesity, and insulin secretion
err2004-01-01
err0
PREAI
errHua Wang; Winston S. Chu; Tong Lu; Sandra J. Hasstedt; Philip A. Kern; Steven C. Elbein
err分享
err收藏
Learning to search: Functional gradient techniques for imitation learning
err2009-06-17
err148
PREAI
errRatliff, Nathan D.; Silver, David; Bagnell, J. Andrew
err分享
err收藏
学者 查看更多内容