arrow
返回

Graph Convolutional Reinforcement Learning for Advanced Energy-Aware Process Planning

delete2023-05-01
delete9
PRE
AI
Q
Qinge Xiao
牛
牛犇 (Ben Niu) *
B
Bing Xue
L
Luoke Hu
DOI:10.1109/TSMC.2022.3219407delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
With the growing demands on green short life-cycle products, advanced energy-aware process planning (AEPP) becomes critical. A major limitation of the existing methods is the poor resistance to the perturbations encountered in advanced machining systems. Therefore, a graph convolutional reinforcement learning (GCRL) method is proposed to overcome such limitations. In this method, a graph convolutional policy network is trained to rapidly adapt the learned commonalities to specific tasks. Unlike algorithms that fix decision variables before optimization, this method employs graph generation to represent AEPP while taking into consideration the flexibilities of operations, machines, and cutting tools. The problem is reformulated as a novel Markov decision process (MDP) to describe the dynamic generation procedure of process plans. A graph convolutional network (GCN) is concurrently used to perform graph embedding to compress the topology of input graphs. Additionally, reinforcement learning (RL) is used to achieve robust and intuitive learning for process planning. To improve the adaption performance of the proposed GCRL, a two-phase multitask training strategy is adopted. Learning efficiency is improved because agents can incorporate both intertask similarities and task-specific rules. A comprehensive case study, including energy characteristics and algorithm performance analyses, is also performed to validate the developed method.
Keyword:
Advanced process planning
graph generation
reinforcement learning (RL)
sustainable manufacturing

期刊

IEEE Transactions on Cybernetics 封面图
IEEE Transactions on Cybernetics
IF:
10.5
论文数:
1.1W
被引数:
5.0W

机构

V
Victoria University Wellington
学者数:
5.6K
论文数: 5.9K
被引数: 54
S
shenzhen university
学者数:
4.6W
论文数: 3.4W
被引数: 72
H
Hangzhou City University
学者数:
2.2K
论文数: 2.0K
被引数: 1.0K
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Bioaccumulation of metals in mussels from four sites of the coastal region of Baja California
err1999-03-06
err0
errOAAI
errEA Gutiérrez-Galindo; JA Villaescusa-Celaya; A Arreola-Chimal
err分享
err收藏
Optimal Control Approach for Turning Process Planning Optimization
err2014-07-01
err11
PREAI
errHeydari, Ali; Landers, Robert G.; Balakrishnan, Sivasubramanya Nadar
err分享
err收藏
An improved epsilon constraint-handling method in MOEA/D for CMOPs with large infeasible regions
err2019-02-04
err238
PREAI
errFan, Zhun; Li, Wenji; Cai, Xinye; Huang, Han; Fang, Yi; You, Yugen; Mo, Jiajie; Wei, Caimin; Goodman, Erik
err分享
err收藏
A novel modified binary differential evolution algorithm and its applications
err2012-12-01
err93
PREAI
errWang, Ling; Fu, Xiping; Mao, Yunfei; Menhas, Muhammad Ilyas; Fei, Minrui
err分享
err收藏
学者 查看更多内容