.png){kind=icon}
返回
Safe MPC Alignment With Human Directional Feedback
.png){kind=icon}
PRE
AI
DOI：10.1109/TRO.2026.3651678.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In safety-critical robot planning or control, manually specifying safety constraints or learning them from demonstrations can be challenging. In this article, we propose a certifiable alignment method for a robot to learn a safety constraint in its model predictive control policy with human online directional feedback. To the best of authors’ knowledge, it is the first method to learn safety constraints from human feedback. The proposed method is based on an empirical observation: human directional feedback, when available, tends to guide the robot toward safer regions. The method only requires the direction of human feedback to update the learning hypothesis space. It is certifiable, providing an upper bound on the total number of human feedback in the case of successful learning, or declaring the hypothesis misspecification, i.e., the true implicit safety constraint cannot be found within the specified hypothesis space. We evaluated the proposed method using numerical examples and user studies in two simulation games. In addition, we implemented and tested the proposed method on a real-world Franka robot arm performing mobile water-pouring tasks. The results demonstrate the efficacy and efficiency of our method, showing that it enables a robot to successfully learn safety constraints with a small handful (tens) of human directional corrections.
Keyword:
Constraint inference
human–robot interaction
learning from human feedback
model predictive control (MPC)
期刊
IF:
10.5
论文数:
3.3K
被引数:
2.8W
机构
引用论文
.png){kind=icon}
The Effect of Modeling Human Rationality Level on Learning Rewards from Multiple Feedback Types人类理性水平建模对多种反馈类型学习奖励的影响
OAAI
OAAI分享收藏DeepSDF: Learning Continuous Signed Distance Functions for Shape RepresentationDeepSDF: 学习用于形状表示的连续符号距离函数
PREAI
分享收藏分享收藏
查看更多内容