返回
Graph Convolutional Reinforcement Learning for Advanced Energy-Aware Process Planning
DOI:10.1109/TSMC.2022.3219407.png)
摘要
En 中文
With the growing demands on green short life-cycle products, advanced energy-aware process planning (AEPP) becomes critical. A major limitation of the existing methods is the poor resistance to the perturbations encountered in advanced machining systems. Therefore, a graph convolutional reinforcement learning (GCRL) method is proposed to overcome such limitations. In this method, a graph convolutional policy network is trained to rapidly adapt the learned commonalities to specific tasks. Unlike algorithms that fix decision variables before optimization, this method employs graph generation to represent AEPP while taking into consideration the flexibilities of operations, machines, and cutting tools. The problem is reformulated as a novel Markov decision process (MDP) to describe the dynamic generation procedure of process plans. A graph convolutional network (GCN) is concurrently used to perform graph embedding to compress the topology of input graphs. Additionally, reinforcement learning (RL) is used to achieve robust and intuitive learning for process planning. To improve the adaption performance of the proposed GCRL, a two-phase multitask training strategy is adopted. Learning efficiency is improved because agents can incorporate both intertask similarities and task-specific rules. A comprehensive case study, including energy characteristics and algorithm performance analyses, is also performed to validate the developed method.
Keyword:
Advanced process planning
graph generation
reinforcement learning (RL)
sustainable manufacturing
期刊
IF:
10.5
论文数:
1.1W
被引数:
5.0W
机构
引用论文
A Simple and Fast Hypervolume Indicator-Based Multiobjective Evolutionary Algorithm一种简单快速的基于超体积指标的多目标进化算法
An improved epsilon constraint-handling method in MOEA/D for CMOPs with large infeasible regions
SOFT COMPUTING
IF2.5
Cloud-based adaptive process planning considering availability and capabilities of machine tools考虑机床可用性和功能的基于云的自适应工艺规划

