arrow
返回

Active reward learning with a novel acquisition function

delete2015-07-16
delete39
PRE
AI
C
Christian Daniel *
O
Oliver Kroemer
M
Malte Viering
J
Jan Metz
J
Jan Peters
DOI:10.1007/s10514-015-9454-zdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Reward functions are an essential component of many robot learning methods. Defining such functions, however, remains hard in many practical applications. For tasks such as grasping, there are no reliable success measures available. Defining reward functions by hand requires extensive task knowledge and often leads to undesired emergent behavior. We introduce a framework, wherein the robot simultaneously learns an action policy and a model of the reward function by actively querying a human expert for ratings. We represent the reward model using a Gaussian process and evaluate several classical acquisition functions (AFs) from the Bayesian optimization literature in this context. Furthermore, we present a novel AF, expected policy divergence. We demonstrate results of our method for a robot grasping task and show that the learned reward function generalizes to a similar task. Additionally, we evaluate the proposed novel AF on a real robot pendulum swing-up task.
Keyword:
Reinforcement learning
Active learning
Bayesian optimization
Preference learning
Inverse reinforcement learning
Reward functions
Acquisition functions
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Autonomous Robots 封面图
Autonomous Robots
IF:
4.3
论文数:
1.7K
被引数:
5.0K

机构

T
Technical University of Darmstadt
学者数:
1.3W
论文数: 10.0K
被引数: 1.2W
引用论文

引用论文

Actions of compounds manipulating the nitric Oxide system in the cat primary visual cortex
err2004-09-30
err0
errOAAI
errJavier Cudeiro; Casto Rivadulla; Rosa Rodriguez; Kenneth L. Grieve; Susana Martínez‐Conde; Carlos Acuña
err分享
err收藏
err分享
err收藏
The D″ discontinuity and its implications
err1998-01-01
err0
PREAI
errMichael E. Wysession; Thorne Lay; Justin Revenaugh; Quentin Williams; Edward J. Garnero; Raymond Jeanloz; Louise H. Kellogg
err分享
err收藏
What Is the Relationship of Fear Avoidance to Physical Function and Pain Intensity in Injured Athletes?
err2018-02-16
err0
errOAAI
errStefan F. Fischerauer; Mojtaba Talaei-Khoei; Rens Bexkens; David C. Ring; Luke S. Oh; Ana-Maria Vranceanu
err分享
err收藏
New extension of the Kalman filter to nonlinear systems
err1997-07-28
err0
PREAI
errSimon J. Julier; Jeffrey K. Uhlmann
err分享
err收藏
Learning to search: Functional gradient techniques for imitation learning
err2009-06-17
err148
PREAI
errRatliff, Nathan D.; Silver, David; Bagnell, J. Andrew
err分享
err收藏
学者 查看更多内容