arrow
Return

Safe Adversarial Control Through Interaction

delete2026-01-01
delete0
PRE
AI
B
Benedikt Rank *
M
Mario Trapp
DOI:10.1007/978-3-032-02018-5_41delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
A significant problem for safety in navigation is managing the interaction with humans. Especially in highly co-located environments, preventing collisions when navigating constrained spaces while mitigating path deviations and velocity reductions remains challenging. By coordinating with humans and proactively shaping interactions through communicating intent, the robot can increase its room to maneuver through bottlenecks. Human-robot interaction heavily relies on machine learning (ML) to interface with humans. As ML functions are complex to certify, previous work on resilience architectures has focused on delineating safety and utility concerns into separate subsystems, thereby removing utility-specific subsystems from the safety-critical path. However, conventional Safety Envelopes overconstrain these subsystems, substantially reducing flexibility and performance gains realized by ML functions. To this end, expanding on our previous work, an architecture is proposed in which a utility-specific subsystem learns via reinforcement learning to shape the interaction with humans to actively evade the intervention of the safety system based on its feedback. By proactively shaping interactions through early coordination with humans, the time scale on which and the constrained state space in which the utility-driving subsystems operate are effectively extended. To evaluate the proposed architecture's potential, a preliminary simulation experiment is conducted.
Keywords:
Safety
Resilience Architecture
HRI
RL

Journal

C
COMPUTER SAFETY, RELIABILITY, AND SECURITY. SAFECOMP 2025 WORKSHOPS, COC3CPS, DECSOS, SASSUR, SENSEI, SRTOITS, AND WAISE
IF:
0
Papers:
39
Citations:
0

Organization

T
technical university of munich
Scholars:
7.4K
Papers: 2.9K
Citations: 1
Cited Papers

Cited Papers

Aggressive driving with model predictive path integral control
err2016-05-01
err0
PREAI
errGrady Williams; Paul Drews; Brian Goldfain; James M. Rehg; Evangelos A. Theodorou
errShare
errSave
An Introduction to Self‐Adaptive Systems
err
IF0
err2020-10-22
err0
PREAI
errDanny Weyns
errShare
errSave
The Marathon 2: A Navigation System
err2020-10-24
err0
errOAAI
errSteve Macenski; Francisco Martin; Ruffin White; Jonatan Gines Clavero
errShare
errSave
The vision of autonomic computing
err2003-01-01
err0
PREAI
errJ.O. Kephart; D.M. Chess
errShare
errSave
Neural Simplex Architecture
err2020-08-10
err0
errOAAI
errDung T. Phan; Radu Grosu; Nils Jansen; Nicola Paoletti; Scott A. Smolka; Scott D. Stoller
errShare
errSave
Reinforcement Learning: A Survey
err1996-05-01
err0
errOAAI
errL. P. Kaelbling; M. L. Littman; A. W. Moore
errShare
errSave
researcher View more