arrow
返回

A parallel scheduling algorithm for reinforcement learning in large state space

delete2012-11-10
delete1
PRE
AI
Q
Quan Liu *
杨
杨旭东 (Xudong Yang)
J
Jing Ling
J
Jin Li
J
Jiao Li
DOI:10.1007/s11704-012-1098-ydelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The main challenge in the area of reinforcement learning is scaling up to larger and more complex problems. Aiming at the scaling problem of reinforcement learning, a scalable reinforcement learning method, DCS-SRL, is proposed on the basis of divide-and-conquer strategy, and its convergence is proved. In this method, the learning problem in large state space or continuous state space is decomposed into multiple smaller subproblems. Given a specific learning algorithm, each subproblem can be solved independently with limited available resources. In the end, component solutions can be recombined to obtain the desired result. To address the question of prioritizing subproblems in the scheduler, a weighted priority scheduling algorithm is proposed. This scheduling algorithm ensures that computation is focused on regions of the problem space which are expected to be maximally productive. To expedite the learning process, a new parallel method, called DCS-SPRL, is derived from combining DCS-SRL with a parallel scheduling architecture. In the DCS-SPRL method, the subproblems will be distributed among processors that have the capacity to work in parallel. The experimental results show that learning based on DCS-SPRL has fast convergence speed and good scalability.
Keyword:
divide-and-conquer strategy
parallel schedule
scalability
large state space
continuous state space

期刊

Frontiers of Computer Science 封面图
Frontiers of Computer Science
IF:
4.6
论文数:
1.6K
被引数:
2.8K

机构

N
nanjing university
学者数:
7.8W
论文数: 5.6W
被引数: 87
S
soochow university - china
学者数:
5.2W
论文数: 3.6W
被引数: 82
引用论文

引用论文

The Effects of Three Months of Aerobic and Strength Training on Selected Performance- and Fitness-Related Parameters in Modern Dance Students
err2007-01-01
err0
PREAI
errYiannis Koutedakis; Harmel Hukam; George Metsios; Alan Nevill; Giannis Giakas; Athanasios Jamurtas; Lynn Myszkewycz
err分享
err收藏
err分享
err收藏
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Characterization, adsorption, and electrokinetic properties of modified sepiolite
err2015-11-03
err0
PREAI
errPınar Turan Beyli; Mehmet Doğan; Mahir Alkan; Aydın Türkyılmaz; Yasemin Turhan; Özkan Demirbaş; Hilmi Namli
err分享
err收藏
没有更多内容