arrow
返回

Expert Intervention Learning An online framework for robot learning from explicit and implicit human feedback

delete2021-10-19
delete13
PRE
AI
J
Jonathan Spencer *
S
Sanjiban Choudhury
M
Matthew Barnes
M
Matthew Schmittle
M
Mung Chiang
P
Peter J. Ramadge
S
Sidd Srinivasa
DOI:10.1007/s10514-021-10006-9delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Scalable robot learning from human-robot interaction is critical if robots are to solve a multitude of tasks in the real world. Current approaches to imitation learning suffer from one of two drawbacks. On the one hand, they rely solely on off-policy human demonstration, which in some cases leads to a mismatch in train-test distribution. On the other, they burden the human to label every state the learner visits, rendering it impractical in many applications. We argue that learning interactively from expert interventions enjoys the best of both worlds. Our key insight is that any amount of expert feedback, whether by intervention or non-intervention, provides information about the quality of the current state, the quality of the action, or both. We formalize this as a constraint on the learner's value function, which we can efficiently learn using no regret, online learning techniques. We call our approach Expert Intervention Learning (EIL), and evaluate it on a real and simulated driving task with a human expert, where it learns collision avoidance from scratch with just a few hundred samples (about one minute) of expert control.
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Autonomous Robots 封面图
Autonomous Robots
IF:
4.3
论文数:
1.7K
被引数:
5.0K

机构

P
Princeton University
学者数:
2.1W
论文数: 2.3W
被引数: 5.1W
U
University of Washington
学者数:
8.0W
论文数: 7.0W
被引数: 12.5W
引用论文

引用论文

err分享
err收藏
err分享
err收藏
High performance and safe flight of full-scale helicopters from takeoff to landing with an ensemble of planners全尺寸直升机从起飞到着陆的高性能和安全飞行
err2019-09-05
err8
errOAAI
errChoudhury, Sanjiban; Dugar, Vishal; Maeta, Silvio; MacAllister, Brian; Arora, Sankalp; Althoff, Daniel; Scherer, Sebastian
err分享
err收藏
学者 查看更多内容