返回
Combining Model-Based Q-Learning With Structural Knowledge Transfer for Robot Skill Learning
DOI:10.1109/TCDS.2017.2718938.png)
摘要
En 中文
Learning skills autonomously is a particularly important ability for an autonomous robot. A promising approach is reinforcement learning (RL) where agents learn policy through interaction with its environment. One problem of RL algorithm is how to tradeoff the exploration and exploitation. Moreover, multiple tasks also make a great challenge to robot learning. In this paper, to enhance the performance of RL, a novel learning framework integrating RL with knowledge transfer is proposed. Three basic components are included: 1) probability policy reuse; 2) dynamic model learning; and 3) model-based Q-learning. In this framework, the prelearned skills are leveraged for policy reuse and dynamic learning. In model-based Q-learning, the Gaussian process regression is used to approximate the Q-value function so as to suit for robot control. The prior knowledge retrieved from knowledge transfer is integrated into the model-based Q-learning to reduce the needed learning time. Finally, a human-robot handover experiment is performed to evaluate the learning performance of this learning framework. Experiment results show that fewer exploration is needed to obtain a high expected reward, due to the prior knowledge obtained from knowledge transfer.
Keyword:
Gaussian process (GP)
knowledge transfer
model-based Q-learning
reinforcement learning (RL)
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
4.9
论文数:
1.1K
被引数:
3.5K
机构
引用论文
Brittle and ductile deformation in a zone of rapid uplift: Central Southern Alps, New Zealand
Tectonics
IF0
Recruitment of a Tropical Colonial Ascidian: Relative Importance of Pre‐Settlement vs. Post‐Settlement Processes
Ecology
IF0

