Safe MPC Alignment With Human Directional Feedback

Zhixian Xie

doi:10.1109/TRO.2026.3651678

Safe MPC Alignment With Human Directional Feedback

2026-01-01

0

PRE

AI

DOI：10.1109/TRO.2026.3651678

Original

Original request for help

Save

Abstract

En 中文

In safety-critical robot planning or control, manually specifying safety constraints or learning them from demonstrations can be challenging. In this article, we propose a certifiable alignment method for a robot to learn a safety constraint in its model predictive control policy with human online directional feedback. To the best of authors’ knowledge, it is the first method to learn safety constraints from human feedback. The proposed method is based on an empirical observation: human directional feedback, when available, tends to guide the robot toward safer regions. The method only requires the direction of human feedback to update the learning hypothesis space. It is certifiable, providing an upper bound on the total number of human feedback in the case of successful learning, or declaring the hypothesis misspecification, i.e., the true implicit safety constraint cannot be found within the specified hypothesis space. We evaluated the proposed method using numerical examples and user studies in two simulation games. In addition, we implemented and tested the proposed method on a real-world Franka robot arm performing mobile water-pouring tasks. The results demonstrate the efficacy and efficiency of our method, showing that it enables a robot to successfully learn safety constraints with a small handful (tens) of human directional corrections.

Keywords:

Constraint inference

human–robot interaction

learning from human feedback

model predictive control (MPC)

Safe MPC Alignment With Human Directional Feedback

Abstract

Journal

Organization