arrow
返回

AGV dispatching algorithm based on deep Q-network in CNC machines environment

delete2021-10-26
delete9
PRE
AI
K
Kyuchang Chang
S
Seung Hwan Park
J
Jun‐Geol Baek *
DOI:10.1080/0951192X.2021.1992669delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This research focuses on providing an optimal dispatching algorithm for an automatic guided vehicle (AGV) in a mobile metal board manufacturing facility. The target process comprises multiple computerized numerical control (CNC) machines and an AGV. An AGV feeds materials between two rows of CNC machines for processing metal boards, or conveys a work in process. As it is difficult to derive a mathematically optimal working order owing to the high computational cost, simple dispatching rules have typically been applied in such environments. However, these rules are generally not optimal, and expert knowledge is required to determine which rule to choose. To overcome certain of these disadvantages and increase productivity, a deep reinforcement learning (RL) algorithm is used to learn an AGV's dispatching algorithm. The target production line as a virtual simulated grid-shaped workspace is modeled to develop a deep Q-network (DQN)-based dispatching algorithm. A convolutional neural network (CNN) is used to input raw pixels and output a value function for estimating future rewards, and an agent is trained to successfully learn the control policies. To create an elaborate dispatching strategy, different hyper-parameters of the DQN are tuned and a reasonable modeling method is experimentally determined. The proposed method automatically develops an optimal dispatching policy without requiring human control or prior expert knowledge. Compared with general heuristic dispatching rules, the results illustrate the improved performance of the proposed methodology.
Keyword:
Automated guided vehicle (AGV)
dispatching algorithm
deep Q-network (DQN)
reinforcement learning (RL)
computerized numerical control (CNC) machines
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
International Journal of Computer Integrated Manufacturing
IF:
4
论文数:
2.3K
被引数:
3.4K

机构

K
Korea University
学者数:
3.6W
论文数: 3.8W
被引数: 4.4W
C
Chungnam National University
学者数:
1.5W
论文数: 1.4W
被引数: 1.2W
引用论文

引用论文

err分享
err收藏
Nanoparticle–membrane interactions
err2017-12-22
err0
errOAAI
errClaudia Contini; Matthew Schneemilch; Simon Gaisford; Nick Quirke
err分享
err收藏
err分享
err收藏
学者 查看更多内容