arrow
Return

RL-CSL: A Combinatorial Optimization Method Using Reinforcement Learning and Contrastive Self-Supervised Learning

delete2023-08-01
delete16
PRE
AI
Z
Zhongju Yuan
G
Genghui Li
Z
Zhenkun Wang *
J
Jianyong Sun
R
Ran Cheng
DOI:10.1109/TETCI.2021.3139802delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Reinforcement learning-based methods have shown great potential in solving combinatorial optimization problems. However, the related research has not been mature in terms of both models and training methods. This paper proposes a method based on reinforcement learning and contrastive self-supervised learning. To be specific, the proposed method uses an attention model to learn a policy for generating solutions and combines a contrastive self-supervised learning model to learn the attention encoder in the way of node-by-node. Correspondingly, a two-phase learning method, including node-wise learning and solution-wise learning, is adopted to train the attention model and the contrastive self-supervised model jointly and collaboratively. The performance of the proposed method has been verified by numerical experiments on various combinatorial optimization problems.
Keywords:
Learning systems
Optimization
Reinforcement learning
Computational modeling
Costs
Vehicle routing
Computational intelligence
Combinatorial optimization
reinforcement learning
attention model
self-supervised learning
contrastive learning

Journal

I
IEEE Transactions on Emerging Topics in Computational Intelligence
IF:
6.5
Papers:
1.4K
Citations:
4.5K

Organization

X
xi'an jiaotong university
Scholars:
9.2W
Papers: 6.6W
Citations: 75