.png){kind=icon}
返回
Learning From Human Directional Corrections
.png){kind=icon}
OA
AI
DOI：10.1109/TRO.2022.3190221.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This article proposes a novel approach that enables a robot to learn an objective function incrementally from human directional corrections. Existing methods learn from human magnitude corrections; since a human needs to carefully choose the magnitude of each correction, those methods can easily lead to overcorrections and learning inefficiency. The proposed method only requires human directional corrections-corrections that only indicate the direction of an input change without indicating its magnitude. We only assume that each correction, regardless of its magnitude, points in a direction that improves the robot's current motion relative to an unknown objective function. The allowable corrections satisfying this assumption account for half of the input space, as opposed to the magnitude corrections that have to lie in a shrinking level set. For each directional correction, the proposed method updates the estimate of the objective function based on a cutting plane method, which has a geometric interpretation. We have established theoretical results to show the convergence of the learning process. The proposed method has been tested in numerical examples, a user study on two human-robot games, and a real-world quadrotor experiment. The results confirm the convergence of the proposed method and further show that the method is significantly more effective (higher success rate), efficient/effortless (less human corrections needed), and potentially more accessible (fewer early wasted trials) than the state-of-the-art robot learning frameworks.
Keyword:
Robots
Linear programming
Trajectory
Robot motion
Cost function
Convergence
Costs
Cutting-plane method
human-robot physical interaction
inverse reinforcement learning
learning from corrections
learning from demonstrations (LfD)
motion planning
期刊
IF:
10.5
论文数:
3.3K
被引数:
2.8W
机构
引用论文
.png){kind=icon}
Value of serum tumor markers for predicting EGFR mutations in non-small cell lung cancer patients
PREAI
分享收藏
CasADi: a software framework for nonlinear optimization and optimal controlCasADi: 非线性优化和最优控制的软件框架
PREAI
分享收藏
查看更多内容