arrow
返回

Reinforcement learning with Gaussian processes for condition-based maintenance

delete2021-08-01
delete25
PRE
AI
S
Shenglin Peng
Q
Qianmei Feng *
DOI:10.1016/j.cie.2021.107321delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Condition-based maintenance strategies are effective in enhancing reliability and safety for complex engineering systems that exhibit degradation phenomena with uncertainty. Such sequential decision-making problems are often modeled as Markov decision processes (MDPs) when the underlying process has a Markov property. Recently, reinforcement learning (RL) becomes increasingly efficient to address MDP problems with large state spaces. In this paper, we model the condition-based maintenance problem as a discrete-time continuous-state MDP without discretizing the deterioration condition of the system. The Gaussian process regression is used as function approximation to model the state transition and the value functions of states in reinforcement learning. A RL algorithm is then developed to minimize the long-run average cost (instead of the commonly-used discounted reward) with iterations on the state-action value function and the state value function, respectively. We verify the capability of the proposed algorithm by simulation experiments and demonstrate its advantages in a case study on a battery maintenance decision-making problem. The proposed algorithm outperforms the discrete MDP approach by achieving lower long-run average costs.
Keyword:
Condition-based maintenance
Reinforcement learning
Gaussian process regression
Markov decision process
Gaussian processes for reinforcement learning
Function approximation
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Computers and Industrial Engineering 封面图
Computers and Industrial Engineering
IF:
6.5
论文数:
1.0W
被引数:
3.8W

机构

U
university of houston system
学者数:
1.4W
论文数: 1.4W
被引数: 16
引用论文

引用论文

Intestinal Microbiota in Hirschsprung Disease
err2018-11-01
err0
errOAAI
errMalla I. Neuvonen; Katri Korpela; Kristiina Kyrklund; Anne Salonen; Willem de Vos; Risto J. Rintala; Mikko P. Pakarinen
err分享
err收藏
Design and Realization of a Linear Magnetic Gear
err2011-10-01
err0
PREAI
errRobert C. Holehouse; Kais Atallah; Jiabin Wang
err分享
err收藏
err分享
err收藏
Reinforcement Learning-Based and Parametric Production-Maintenance Control Policies for a Deteriorating Manufacturing System
err2018-01-01
err63
errOAAI
errXanthopoulos, A. S.; Kiatipis, Athanasios; Koulouriotis, D. E.; Stieger, Sepp
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容