arrow
返回

Combining Model-Based Q-Learning With Structural Knowledge Transfer for Robot Skill Learning

delete2019-03-01
delete28
PRE
AI
Z
Zhen Deng *
H
Haojun Guan
R
Rui Huang
H
Hongzhuo Liang
张
张立伟 (Liwei Zhang)
张
张建伟 (Jianwei Zhang)
DOI:10.1109/TCDS.2017.2718938delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Learning skills autonomously is a particularly important ability for an autonomous robot. A promising approach is reinforcement learning (RL) where agents learn policy through interaction with its environment. One problem of RL algorithm is how to tradeoff the exploration and exploitation. Moreover, multiple tasks also make a great challenge to robot learning. In this paper, to enhance the performance of RL, a novel learning framework integrating RL with knowledge transfer is proposed. Three basic components are included: 1) probability policy reuse; 2) dynamic model learning; and 3) model-based Q-learning. In this framework, the prelearned skills are leveraged for policy reuse and dynamic learning. In model-based Q-learning, the Gaussian process regression is used to approximate the Q-value function so as to suit for robot control. The prior knowledge retrieved from knowledge transfer is integrated into the model-based Q-learning to reduce the needed learning time. Finally, a human-robot handover experiment is performed to evaluate the learning performance of this learning framework. Experiment results show that fewer exploration is needed to obtain a high expected reward, due to the prior knowledge obtained from knowledge transfer.
Keyword:
Gaussian process (GP)
knowledge transfer
model-based Q-learning
reinforcement learning (RL)
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Cognitive and Developmental Systems 封面图
IEEE Transactions on Cognitive and Developmental Systems
IF:
4.9
论文数:
1.1K
被引数:
3.5K

机构

U
university of hamburg
学者数:
3.7W
论文数: 2.9W
被引数: 30
F
fuzhou university
学者数:
3.3W
论文数: 2.1W
被引数: 31
引用论文

引用论文

err分享
err收藏
Bayesian policy reuse
err2016-02-22
err60
errOAAI
errRosman, Benjamin; Hawasly, Majd; Ramamoorthy, Subramanian
err分享
err收藏
Regulation of brain neurotransmitter release and of adenylate cyclase activity by opioid receptors
err1992-05-01
err0
PREAI
errAnton N. M. Schoffelmeer; Bernard J. Van Vliet; Taco J. De Vries; Menno H. Heijna; Arie H. Mulder
err分享
err收藏
Verifying the Drude response*
err2006-05-24
err0
PREAI
errM. Dressel; M. Scheffler
err分享
err收藏
err分享
err收藏
学者 查看更多内容