arrow
Return

A Q-learning-based algorithm for the 2D-rectangular packing problem

delete2023-06-04
delete3
PRE
AI
X
Xusheng Zhao
Y
Yunqing Rao *
孟荣华 cover
孟荣华 (Ronghua Meng)
方杰 cover
方杰 (Jie Fang)
DOI:10.1007/s00500-023-08381-9delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper presents a Q-learning-based algorithm for sequence and orientation optimization toward the 2D rectangular strip packing problem. The width-filled skyline is used to represent the interior packing state, and a constructive rectangular packing algorithm with the commonly adopted fitness evaluation for placement is designed. Then, the consecutive item packing is simulated as Markov Decision Process, where the state is defined as the set of already packed items, and the action is defined as the rectangle selected to be packed along with its orientation. We propose the reverse updating of Q-value in the paradigm of Q-learning and use the algorithm to optimize the sequence and orientation of the rectangles. The decreasing-size-choice mechanism in Q-learning is studied on randomly generated problems to optimize the setting of epsilon-greedy policy. We also test the Q-learning-based algorithm on the benchmark instances of C21, N13, N-series from NT, Cgcut and Beng. Compared with a few state-of-the-art algorithms, the computational results show that the proposed algorithm can produce good packing quality when adequate execution time allowed.
Keywords:
Rectangular packing problem
Combinatorial optimization
Fitness degree
Reinforcement learning

Journal

Soft Computing cover
Soft Computing
IF:
2.5
Papers:
1.0W
Citations:
2.2W

Organization

C
China Three Gorges University
Scholars:
640
Papers: 179
Citations: 1
Cited Papers

Cited Papers

Simulation of geosynchronous radar and atmospheric phase compensation constraints
err2013-01-01
err0
PREAI
errS.E. Hobbs; C. Mitchell; B. Snapir; R. Burren; P. Whittaker; B. Forte; R. Corstanje; K. Graham; R. Holley
errShare
errSave
The geometry of nesting problems: A tutorial
err2008-01-01
err179
PREAI
errBennell, Julia A.; Oliveira, Jose F.
errShare
errSave
errShare
errSave
The effect of 3-nitropropionic acid on behavioral dysfunction, neuron loss and gliosis in the brain of adult male rats: The case of prefrontal cortex, hippocampus and the cerebellum
err2020-08-01
err0
PREAI
errAbolfazl Torabi; Mohammadjavad Joneidi; Ibrahim Mohammadzadeh; Mohammad-amin Abdollahifar; Aysan Khatmi; Samira Ezi; Meysam Hassani Moghaddam; Romina Rafiei; Farshad Kahrizirad; Mohsen Norozian; Abbas Aliaghaei
errShare
errSave
researcher View more