arrow
返回

Deep Reinforcement Learning Verification: A Survey

delete2023-07-17
delete11
delete
OA
AI
M
Matthew Landers *
A
Afsaneh Doryab
DOI:10.1145/3596444delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep reinforcement learning (DRL) has proven capable of superhuman performance on many complex tasks. To achieve this success, DRL algorithms train a decision-making agent to select the actions that maximize some long-term performance measure. In many consequential real-world domains, however, optimal performance is not enough to justify an algorithm's use-for example, sometimes a system's robustness, stability, or safety must be rigorously ensured. Thus, methods for verifying DRL systems have emerged. These algorithms can guarantee a system's properties over an infinite set of inputs, but the task is not trivial. DRL relies on deep neural networks (DNNs). DNNs are often referred to as black boxes because examining their respective structures does not elucidate their decision-making processes. Moreover, the sequential nature of the problems DRL is used to solve promotes significant scalability challenges. Finally, because DRL environments are often stochastic, verification methods must account for probabilistic behavior. To address these complications, a new subfield has emerged. In this survey, we establish the foundations of DRL and DRL verification, define a taxonomy for DRL verification methods, describe approaches for dealing with stochasticity, characterize considerations related to writing specifications, enumerate common testing tasks/environments, and detail opportunities for future research.
Keyword:
Deep reinforcement learning
neural network verification
trustworthy reinforcement learning

期刊

ACM Computing Surveys 封面图
ACM Computing Surveys
IF:
28
论文数:
2.5K
被引数:
3.5W

机构

U
University of Virginia
学者数:
3.0W
论文数: 2.7W
被引数: 4.1W
引用论文

引用论文

Mini‐Mental State Examination
err2002-04-30
err0
PREAI
errJoseph R. Cockrell; Marshal F. Folstein
err分享
err收藏
err分享
err收藏
Deep Reinforcement Learning: A Brief Survey深度强化学习: 简要综述
err2017-11-01
err2.4K
errOAAI
errArulkumaran, Kai; Deisenroth, Marc Peter; Brundage, Miles; Bharath, Anil Anthony
err分享
err收藏
Deep expression scrutiny of juxtaposed wild and cultivated lentil furnishes new insight into aluminium tolerance mechanism
err
IF0
err2020-01-23
err0
errOAAI
errDharmendra Singh; Chandan Kumar Singh; Jyoti Taunk; Ram Sewak Singh Tomar; Madan Pal; Noren Singh Konjengbam; M. Premjit Singh; Ph Ranjit Sharma; Rakesh Singh Sengar
err分享
err收藏
学者 查看更多内容