arrow
返回

Gradient descent methods in learning classifier systems: Improving XCS performance in multistep problems

delete2005-10-01
delete59
PRE
AI
M
Martin V. Butz
D
David E. Goldberg
P
Pier Luca Lanzi
DOI:10.1109/TEVC.2005.850265delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The accuracy-based XCS classifier system has been shown to solve typical data mining problems in a machine-learning competitive way. However, successful applications in multistep problems, modeled by a Markov decision process, were restricted to very small problems. Until now, the temporal difference learning technique in XCS was based on deterministic updates. However, since a prediction is actually generated by a set of rules in XCS and Learning Classifier Systems in general, gradient-based update methods are applicable. The extension of XCS to gradient-based update methods results in a classifier system that is more robust and more parameter independent, solving large and difficult maze problems reliably. Additionally, the extension to gradient methods highlights the relation of XCS to other function approximation methods in reinforcement learning.
Keyword:
function approximation
gradient descent
learning classifier systems (LCSs)
multistop problems
Q-learning
reinforcement learning
XCS

期刊

IEEE Transactions on Evolutionary Computation 封面图
IEEE Transactions on Evolutionary Computation
IF:
12
论文数:
1.8K
被引数:
2.4W

机构

暂无机构信息
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Trehalose phosphate synthases OtsA1 and OtsA2 ofRhodococcus opacus1CP
err2013-02-25
err0
errOAAI
errDirk Tischler; Susanne Niescher; Stefan R. Kaschabek; Michael Schlömann
err分享
err收藏
err分享
err收藏
Developments in the Theory of Turbulence
err2008-12-30
err0
PREAI
errD. C. Leslie; Cecil E. Leith
err分享
err收藏
学者 查看更多内容