arrow
返回

Guided Proximal Policy Optimization with Structured Action Graph for Complex Decision-making

delete2025-01-07
delete0
PRE
AI
Y
Yiming Yang
邢
邢登鹏 (Dengpeng Xing) *
W
Wannian Xia
王鹏 封面图
王鹏 (Peng Wang)
DOI:10.1007/s11633-024-1503-7delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Reinforcement learning encounters formidable challenges when tasked with intricate decision-making scenarios, primarily due to the expansive parameterized action spaces and the vastness of the corresponding policy landscapes. To surmount these difficulties, we devise a practical structured action graph model augmented by guiding policies that integrate trust region constraints. Based on this, we propose guided proximal policy optimization with structured action graph (GPPO-SAG), which has demonstrated pronounced efficacy in refining policy learning and enhancing performance across sophisticated tasks characterized by parameterized action spaces. Rigorous empirical evaluations of our model have been performed on comprehensive gaming platforms, including the entire suite of StarCraft II and Hearthstone, yielding exceptionally favorable outcomes. Our source code is at https://github.com/sachiel321/GPPO-SAG.
Keyword:
Reinforcement learning
trust region policy optimization
complex decision-making
policy guiding
structured action graph

期刊

Machine Intelligence Research 封面图
Machine Intelligence Research
IF:
8.7
论文数:
304
被引数:
882

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Effect of different nanofillers on non-isothermal crystallization kinetics and electric conductivity of dynamically-vulcanized PP-EPDM Blends
err2016-01-05
err0
PREAI
errBin Yang; Lei Hu; Ru Xia; Fang Chen; Shu-Chun Zhao; Yan-Li Deng; Ming Cao; Jia-Sheng Qian; Peng Chen
err分享
err收藏
Laboratory evaluation of foamed warm mix asphalt
err2018-07-16
err0
PREAI
errAla Abbas; Munir Nazzal; Ayman Ali; Arjun Roy; Samer Dessouky
err分享
err收藏
err分享
err收藏
err分享
err收藏
Efficient Surgical Cutting with Position-Based Dynamics
err2017-05-01
err0
PREAI
errIago Berndt; Rafael Torchelsen; Anderson Maciel
err分享
err收藏
err分享
err收藏
学者 查看更多内容