arrow
返回

First experiments with POWERPLAY

delete2013-05-01
delete20
delete
OA
AI
R
Rupesh K. Srivastava
B
Bas R. Steunebrink
J
Jürgen Schmidhuber *
DOI:10.1016/j.neunet.2013.01.022delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Like a scientist or a playing child, POWERPLAY (Schmidhuber, 2011) not only learns new skills to solve given problems, but also invents new interesting problems by itself. By design, it continually comes up with the fastest to find, initially novel, but eventually solvable tasks. It also continually simplifies or compresses or speeds up solutions to previous tasks. Here we describe first experiments with POWERPLAY. A self-delimiting recurrent neural network SLIM RNN (Schmidhuber, 2012) is used as a general computational problem solving architecture. Its connection weights can encode arbitrary, self-delimiting, halting or non-halting programs affecting both environment (through effectors) and internal states encoding abstractions of event sequences. Our POWERPLAY-driven SLIM RNN learns to become an increasingly general solver of self-invented problems, continually adding new problem solving procedures to its growing skill repertoire. Extending a recent conference paper (Srivastava, Steunebrink, Stollenga, & Schmidhuber, 2012), we identify interesting, emerging, developmental stages of our open-ended system. We also show how it automatically self-modularizes, frequently re-using code for previously invented skills, always trying to invent novel tasks that can be quickly validated because they do not require too many weight changes affecting too many previous tasks. (c) 2013 Elsevier Ltd. All rights reserved.
Keyword:
POWERPLAY
Problem invention
Discovery
Self-delimiting recurrent neural network
Skill learning
Self-modularization
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
8.2K
被引数:
3.0W

机构

U
Universita della Svizzera Italiana
学者数:
3.3K
论文数: 2.8K
被引数: 3
引用论文

引用论文

Optimal Ordered Problem Solver
err2004-03-01
err81
errOAAI
errSchmidhuber, J
err分享
err收藏
Haemodynamic effects of valsartan in acute renal ischaemia/reperfusion injury
err2001-08-01
err0
PREAI
errKai Lopau; Lars Hefner; Gwendolyn Bender; Ekkehart Heidbreder; Christoph Wanner
err分享
err收藏
Control of Inducible Gene Expression by Signal-Dependent Transcriptional Elongation
errCell
IF0
err2009-07-01
err0
errOAAI
errDiana C. Hargreaves; Tiffany Horng; Ruslan Medzhitov
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容