arrow
Return

Safe Multi-agent Reinforcement Learning Using Formal Runtime Enforcement: A Case Study

delete2026-01-01
delete0
PRE
AI
V
Vedanta Mohapatra
A
Ayush Anand
S
Srinivas Pinisetty *
DOI:10.1007/978-3-032-11176-0_28delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Cyber-Physical Systems (CPSs) are increasingly used in safety-critical tasks like search and rescue missions. They are often combined with machine-learning algorithms like Reinforcement Learning (RL) for improved performance and accuracy. There is a pressing need to ensure the safety of such learning-enabled CPSs. In recent research, the Runtime Enforcement (RE) approach has been very successful in formally ensuring the safety of learning-enabled CPS. RE is a formal verification technique that dynamically guarantees the safety of a system. We present a runtime enforcement mechanism for safeguarding a Multi-Agent Reinforcement Learning (MARL) enabled drone swarm CPS. We discuss the enforcement strategies that prevent drones from collision and boundary breach. We show how RE combined with MARL, in addition to guaranteeing safety, improves the overall performance of the swarm system.
Keywords:
Runtime Enforcement
MARL
CPS
Automata

Journal

T
THEORETICAL ASPECTS OF COMPUTING-ICTAC 2025
IF:
0
Papers:
28
Citations:
0

Organization

I
indian institute of technology system (iit system)
Scholars:
9.5W
Papers: 9.9W
Citations: 93