arrow
Return

A system-centred predictive maintenance re-optimization method based on multi-agent deep reinforcement learning

delete2025-05-01
delete0
PRE
AI
Y
Yanping Zhang
B
Baoping Cai *
C
Chuntan Gao *
Y
Yixin Zhao
X
Xiaoyan Shao
C
Chao Yang
DOI:10.1016/j.eswa.2025.127034delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Predictive maintenance (PdM) is a proactive maintenance strategy that utilises data monitoring and analysis to forecast potential failures and perform maintenance activity in advance, which can significantly improve system availability and reduce maintenance costs. However, challenges such as the discrepancy amongst components and the complexity of the multi-component system are difficult to address through current PdM methods. A system-centred PdM re-optimization method based on multi-agent deep reinforcement learning (DRL) is proposed. The existing challenges can be effectively addressed through phased decision-making and collaborative learning amongst multiple agents. Considering the nonlinear characteristics and uncertainty in the degradation process of the engineering system, a synergistic data-model framework is implemented to predict the cumulative degradation value and remaining useful life (RUL). The predicted values of cumulative degradation and RUL serve as multiple environmental observations to balance the environmental dynamics in multi-agent DRL. Considering the differences amongst components, a component-centred PdM decision is initially made according to the optimal component performance and maintenance cost. Given the complexity of the multi-component system, a system-centred PdM decision is re-optimized on the basis of the component-level decision results and the system performance constraint. The two-stage PdM re-optimization method is implemented for a subsea production control system to demonstrate the application of the proposed method.
Keywords:
Predictive maintenance
Multi-agent
Deep reinforcement learning
Subsea production control system

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
3.0W
Citations:
10.2W

Organization

C
China Univ Petr
Scholars:
2.0K
Papers: 764
Citations: 273
Cited Papers

Cited Papers

Prognostics and health management for predictive maintenance: A review
err2024-08-01
err8
PREAI
errHuang, Chao; Bu, Siqi; Lee, Hiu Hung; Chan, Chun Hung; Kong, Shu Wa; Yung, Winco K. C.
errShare
errSave
Predictive maintenance in the Industry 4.0: A systematic literature review
err2020-12-01
err436
PREAI
errZonta, Tiago; da Costa, Cristiano Andre; Righi, Rodrigo da Rosa; de Lima, Miromar Jose; da Trindade, Eduardo Silveira; Li, Guann Pyng
errShare
errSave
A reinforcement learning framework for optimal operation and maintenance of power grids
err2019-05-01
err153
errOAAI
errRocchetta, R.; Bellani, L.; Compare, M.; Zio, E.; Patelli, E.
errShare
errSave
Deep multi-agent reinforcement learning for multi-level preventive maintenance in manufacturing systems
err2022-04-01
err43
PREAI
errSu, Jianyu; Huang, Jing; Adams, Stephen; Chang, Qing; Beling, Peter A.
errShare
errSave
Artificial intelligence enhanced fault prediction with industrial incomplete information
err2025-02-01
err3
PREAI
errShao, Xiaoyan; Cai, Baoping; Zou, Zhexian; Shao, Haidong; Yang, Chao; Liu, Yonghong
errShare
errSave
Deep learning models for predictive maintenance: a survey, comparison, challenges and prospects
err2022-01-18
err99
PREAI
errSerradilla, Oscar; Zugasti, Ekhi; Rodriguez, Jon; Zurutuza, Urko
errShare
errSave
errShare
errSave
Remaining useful life prediction via a hybrid DBN-KF-based method: A case of subsea Christmas tree valves
err2023-10-01
err14
PREAI
errShao, Xiaoyan; Cai, Baoping; Liu, Yonghong; Zhang, Junyan; Sui, Zhongfei; Feng, Qiang
errShare
errSave
researcher View more