arrow
Return

Solving 3D packing problem using Transformer network and reinforcement learning

delete2023-03-01
delete14
PRE
AI
F
Fang Yang
D
Defu Zhang *
DOI:10.1016/j.eswa.2022.119153delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The three-dimensional packing problem (3D-PP) is a classic NP-hard problem in operations research and computer science. One of the most popular ways to solve the problem is heuristic methods with a search strategy. However, approaches based on machine learning have recently received widespread attention because of their efficiency. In this work, we propose a deep reinforcement learning (DRL) model to solve 3D-PP. Our method employs Transformer architecture as the policy network and uses Proximal Policy Optimization (PPO) to train the network. Compared with previous approaches using DRL, our method presents a novel state representation of packing environment, and introduces plane features for representing the length and width information of container. Our method achieves the new state-of-the-art results for using DRL to solve 3D-PP. The code of our method will be released to facilitate future research.
Keywords:
3D packing problem
Deep reinforcement learning
Transformer

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
2.9W
Citations:
10.2W

Organization

X
xiamen university
Scholars:
5.9W
Papers: 3.8W
Citations: 67
Cited Papers

Cited Papers

errShare
errSave
Heuristic algorithm for the container loading problem with multiple constraints
err2017-06-01
err30
PREAI
errLiu Sheng; Shang Xiuqin; Cheng Changjian; Zhao Hongxia; Shen Dayong; Wang Feiyue
errShare
errSave
Inflammatory leiomyosarcoma may be characterized by specific near-haploid chromosome changes
err1998-05-01
err0
PREAI
errPaola Dal Cin; Raf Sciot; Christopher D. M. Fletcher; Ignace Samson; Rita De Vos; Nils Mandahl; Helena Willén; Olle Larsson; Herman Van den Berghe
errShare
errSave
researcher View more