arrow
Return

A Reinforcement Learning Based Large-Scale Refinery Production Scheduling Algorithm

delete2024-10-01
delete1
PRE
AI
Y
Yuandong Chen
J
Jinliang Ding *
Q
Qingda Chen
DOI:10.1109/TASE.2023.3321612delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Refinery production scheduling is a mixed-integer programming problem, which exists the issue of combinational explosion. Thus, solving a large-scale refinery production scheduling problem is time-consuming. This article proposes an approximate solution framework based on reinforcement learning (RL) for large-scale long-time refinery production scheduling problems to rapidly obtain a satisfactory solution. In the proposed algorithm, the Proximal Policy Optimization algorithm is used to process the continuous action. To address the cold start issue of RL in refinery scheduling problem, we present an initialization method for the actor of agent, which utilizes the operation knowledge of tractable small-scale problems to initialize the actor network, and the agent is trained in the environment of large-scale problems. Hence, the convergence of the RL algorithm is greatly accelerated. In addition, the product flowrate concept is used to express the state, making the scheduling agent scalable in terms of scheduling horizon. Experimental studies show, to large-scale refinery scheduling problems, the proposed algorithm can obtain better solutions than that of the CPLEX solver and the existing evolutionary algorithm in a much shorter solving time of the two methods.
Keywords:
Production
Job shop scheduling
Mathematical models
Oils
Reinforcement learning
Optimization
Petroleum
Large-scale optimization
reinforcement learning
refinery
scheduling

Journal

IEEE Transactions on Automation Science and Engineering cover
IEEE Transactions on Automation Science and Engineering
IF:
6.4
Papers:
5.2K
Citations:
1.6W

Organization

N
northeastern university - china
Scholars:
3.2W
Papers: 2.7W
Citations: 37
Cited Papers

Cited Papers

errShare
errSave
Distributed Services Attestation in IoT
err2018-11-30
err0
PREAI
errMauro Conti; Edlira Dushku; Luigi V. Mancini
errShare
errSave
errShare
errSave
Petroleum Refining Operations: Key Issues, Advances, and Opportunities
err2010-12-10
err115
PREAI
errShah, Nikisha K.; Li, Zukui; Ierapetritou, Marianthi G.
errShare
errSave
Centralized-decentralized optimization for refinery scheduling
err2009-12-01
err36
PREAI
errShah, Nikisha; Saharidis, Georgios K. D.; Jia, Zhenya; Ierapetritou, Marianthi G.
errShare
errSave
researcher View more