arrow
Return

An Off-Policy Reinforcement Learning-Based Adaptive Optimization Method for Dynamic Resource Allocation Problem

delete2025-02-01
delete0
PRE
AI
B
Baiyang He
Y
Ying Meng *
L
Lixin Tang
DOI:10.1109/TNNLS.2023.3338237delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this article, an adaptive optimization method is proposed for the dynamic resource allocation problem (RAP) with multiple objectives in the manufacturing industry. In the proposed method, a novel reinforcement learning method () is designed to adaptively set the weights for multiple objectives, and then the optimization method is adopted to generate the noninferior solutions in each time period. To ensure 's performance in dynamic and complex resource allocation environments, we develop a state-encoding network with a proposed information entropy attention mechanism to encode the state. Then, we introduce a new reward function to escape from the local optima of the policy and further present a conditional entropy policy to enhance the policy network. In addition, we demonstrate the feasibility of improving the quality of actions and present a boundary method for high-quality actions. We also introduce an optimization model to automatically adjust the temperature parameter in . Furthermore, we compare and analyze our approach with other state-of-the-art reinforcement learning methods. The experiments illustrate that outperforms state-of-the-art reinforcement learning methods. Moreover, can be generalized to solve optimization problems with two to five objectives, problems with linear, quadratic, cubic, logarithmic, or inverse objectives, and problems with diverse structures.
Keywords:
Conditional entropy
deep reinforcement learning
dynamic resource allocation
soft actor-critic

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.5K
Citations:
7.2W

Organization

N
northeastern university - china
Scholars:
3.1W
Papers: 2.7W
Citations: 37