Robust Deep Reinforcement Learning Using Formal Verification

doi:10.1007/978-3-031-98208-8_11

Robust Deep Reinforcement Learning Using Formal Verification

2026-01-01

0

PRE

AI

DOI：10.1007/978-3-031-98208-8_11

Original

Original request for help

Save

Abstract

En 中文

We propose a method to enhance the robustness and efficiency of deep reinforcement learning (DRL) by integrating formal verification techniques into the training loop. Our approach uses counterexamples generated by verification tools as corrective feedback to guide policy adjustments, enabling the agent to avoid unsafe actions and learn faster. Inspired by imitation learning, the verification tool acts as an expert that continuously refines the neural network when the agent's policy fails. Experiments in challenging environments such as Frozen Lake and Sokoban demonstrate that our method yields substantial improvements in success rates and reduces the number of training episodes by up to 70%, all while significantly enhancing policy safety. We release the code and full reproducibility instructions at https://github.com/ AvrahamRaviv/Robust- DRL- FV.

Keywords:

Deep Reinforcement Learning

Formal Verification

Policy Safety

Counterexample-Guided Learning

Training Efficiency

Robust Deep Reinforcement Learning Using Formal Verification

Abstract

Journal

Organization