arrow
Return

SRL: A segmented reinforcement learning framework for long sequence layout decisions

delete2025-12-04
delete0
delete
OA
AI
J
Jie Yang
陈剑 cover
陈剑 (Jian Chen)
J
Jinjin Hai
K
Kai Qiao
H
Haoran Zhang
B
Bin Yan *
DOI:10.1007/s40747-025-02193-0delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Automated schematic layout for printed circuit boards (PCBs) is a critical step for security applications such as hardware Trojan detection and intellectual property verification. To address the challenges of state action space explosion and low training efficiency in reinforcement learning (RL) for PCB layout, posed by long decision sequences, this paper proposes a Segmented Reinforcement Learning (SRL) framework. SRL decouples long decision chains into sequential independent segments. Within each segment, separate segment agents optimize local policies, reducing state action space complexity while significantly improving training efficiency. Furthermore, segment agents achieve global coordination through cascaded propagation of optimal states, allowing SRL to avoid complex policy synchronization, which provides a simple and effective solution for long sequence layout tasks. Experiments conducted on ten representative PCB circuit benchmarks demonstrate that SRL reduces training time by 76.6% compared to traditional RL while exhibiting superior layout quality and enhanced complex problem solving capabilities in long sequence layout tasks.
Keywords:
Segmented Reinforcement Learning
Automated schematic layout
Printed circuit boards
Segments
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Complex and Intelligent Systems cover
Complex and Intelligent Systems
IF:
4.6
Papers:
2.1K
Citations:
6.6K

Organization

I
Information Engineering University
Scholars:
484
Papers: 161
Citations: 0