.png){kind=icon}
Return
Robust Deep Reinforcement Learning Using Formal Verification
.png){kind=icon}
PRE
AI
DOI：10.1007/978-3-031-98208-8_11.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
We propose a method to enhance the robustness and efficiency of deep reinforcement learning (DRL) by integrating formal verification techniques into the training loop. Our approach uses counterexamples generated by verification tools as corrective feedback to guide policy adjustments, enabling the agent to avoid unsafe actions and learn faster. Inspired by imitation learning, the verification tool acts as an expert that continuously refines the neural network when the agent's policy fails. Experiments in challenging environments such as Frozen Lake and Sokoban demonstrate that our method yields substantial improvements in success rates and reduces the number of training episodes by up to 70%, all while significantly enhancing policy safety. We release the code and full reproducibility instructions at https://github.com/ AvrahamRaviv/Robust- DRL- FV.
Keywords:
Deep Reinforcement Learning
Formal Verification
Policy Safety
Counterexample-Guided Learning
Training Efficiency
Journal
T
IF:
0
Papers:
17
Citations:
0
Organization
Cited Papers
.png){kind=icon}
Trainify: A CEGAR-Driven Training and Verification Framework for Safe Deep Reinforcement Learning
OAAI
OAAIShareSave
View more