Knowledge-guided deep reinforcement learning framework for feature machining step sequencing

Pengyu Wang

doi:10.1007/s00170-025-16606-4

Knowledge-guided deep reinforcement learning framework for feature machining step sequencing

2025-09-26

0

PRE

AI

DOI：10.1007/s00170-025-16606-4

Original

Original request for help

Save

Abstract

En 中文

Machining sequencing is a critical step in computer-aided process planning (CAPP) for numerical control (NC) machining, directly impacting efficiency and cost. Consequently, the machining sequencing method is crucial for practical manufacturing processes. However, existing sequencing methods face two main limitations: (1) they often treat machining features (MFs) as the smallest unit, neglecting that complex features require decomposition into sub-features and multiple feature machining steps (FMSs); (2) while exact methods are very time-consuming, prevailing approximate methods suffer from inconsistent performance, repeated iterative computations, and an inability to learn from experience. To address these challenges, this paper proposes a knowledge-guided deep reinforcement learning (DRL) framework for FMS-level sequencing. The method incorporates dynamic selection masks to enforce machining constraints and a process knowledge-based cost model to ensure efficient convergence. Leveraging the sequencing experience acquired during the learning process, this method can solve the machining sequencing problem within an acceptable computation time. Experiments demonstrate that the proposed method outperforms existing methods in both total cost and computation time, enabling more efficient machining of complex parts.

Keywords:

Machining features

Feature sequencing

Reinforcement learning

Intelligent manufacturing

Knowledge-guided deep reinforcement learning framework for feature machining step sequencing

Abstract

Journal

Organization