arrow
Return

Projective simulation with generalization

delete2017-10-31
delete30
delete
OA
AI
A
Alexey Melnikov *
A
Adi Makmal
V
Vedran Dunjko
H
Hans J. Briegel
DOI:10.1038/s41598-017-14740-ydelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The ability to generalize is an important feature of any intelligent agent. Not only because it may allow the agent to cope with large amounts of data, but also because in some environments, an agent with no generalization capabilities cannot learn. In this work we outline several criteria for generalization, and present a dynamic and autonomous machinery that enables projective simulation agents to meaningfully generalize. Projective simulation, a novel, physical approach to artificial intelligence, was recently shown to perform well in standard reinforcement learning problems, with applications in advanced robotics as well as quantum experiments. Both the basic projective simulation model and the presented generalization machinery are based on very simple principles. This allows us to provide a full analytical analysis of the agent's performance and to illustrate the benefit the agent gains by generalizing. Specifically, we show that already in basic (but extreme) environments, learning without generalization may be impossible, and demonstrate how the presented generalization machinery enables the projective simulation agent to learn.
Keywords:
REINFORCEMENT
ABSTRACTION
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Scientific Reports cover
Scientific Reports
IF:
3.9
Papers:
28.3W
Citations:
83.5W

Organization

U
University of Innsbruck
Scholars:
9.8K
Papers: 8.6K
Citations: 8
Cited Papers

Cited Papers

Evaluation of corrosion protective properties of fly ash-red mud based geopolymer coating material for mild steel
err2022-01-01
err0
PREAI
errAkshay Singh Tomar; Rainy Gupta; Archana Singh; Shabi Thankaraj Salammal; Mohd. Akram Khan; Deepti Mishra
errShare
errSave
Magnetic behavior of biosynthesized Co 3 O 4 nanoparticles
err2017-02-01
err0
PREAI
errA. Diallo; T.B. Doyle; B.M. Mothudi; E. Manikandan; V. Rajendran; M. Maaza
errShare
errSave
Distributed Services Attestation in IoT
err2018-11-30
err0
PREAI
errMauro Conti; Edlira Dushku; Luigi V. Mancini
errShare
errSave
Methylglyoxal Induces Platelet Hyperaggregation and Reduces Thrombus Stability by Activating PKC and Inhibiting PI3K/Akt Pathway
err2013-09-13
err0
errOAAI
errKarin Hadas; Voahanginirina Randriamboavonjy; Amro Elgheznawy; Alexander Mann; Ingrid Fleming
errShare
errSave
Coherent controlization using superconducting qubits
err2015-12-15
err30
errOAAI
errFriis, Nicolai; Melnikov, Alexey A.; Kirchmair, Gerhard; Briegel, Hans J.
errShare
errSave
researcher View more