arrow
返回

Benchmarking Projective Simulation in Navigation Problems

delete2018-01-01
delete17
delete
OA
AI
A
Alexey Melnikov *
A
Adi Makmal
H
Hans J. Briegel
DOI:10.1109/ACCESS.2018.2876494delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Projective simulation is a model for intelligent agents with a deliberation capacity that is based on episodic memory. The model has been shown to provide a flexible framework for constructing reinforcement-learning agents, and it allows for quantum mechanical generalization, which leads to a speedup in deliberation time. Projective simulation agents have been applied successfully in the context of complex skill learning in robotics and the design of the state-of-the-art quantum experiments. In this paper, we study the performance of projective simulation in two benchmarking problems in navigation, namely, the grid world and the mountain car problem. The performance of projective simulation is compared to standard tabular reinforcement learning approaches, Q-learning, and SARSA. Our comparison demonstrates that the performance of projective simulation and standard learning approaches are qualitatively and quantitatively similar, while it is much easier to choose optimal model parameters in the case of projective simulation with reduced computational effort of one to two orders of magnitude. Our results show that the projective simulation model stands out for its simplicity in terms of the number of model parameters, which makes it simple to set up the learning agent in unknown task environments.
Keyword:
Reinforcement learning
projective simulation
benchmarking tasks
navigation problems
random processes
quantum mechanics
learning
delayed rewards
Markov decision processes
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

U
University of Innsbruck
学者数:
9.8K
论文数: 8.6K
被引数: 8
引用论文

引用论文

Magnetic behavior of biosynthesized Co 3 O 4 nanoparticles
err2017-02-01
err0
PREAI
errA. Diallo; T.B. Doyle; B.M. Mothudi; E. Manikandan; V. Rajendran; M. Maaza
err分享
err收藏
err分享
err收藏
Active learning machine learns to create new quantum experiments主动学习机器学习创造新的量子实验
err2018-01-18
err216
errOAAI
errMelnikov, Alexey A.; Nautrup, Hendrik Poulsen; Krenn, Mario; Dunjko, Vedran; Tiersch, Markus; Zeilinger, Anton; Briegel, Hans J.
err分享
err收藏
Methylglyoxal Induces Platelet Hyperaggregation and Reduces Thrombus Stability by Activating PKC and Inhibiting PI3K/Akt Pathway
err2013-09-13
err0
errOAAI
errKarin Hadas; Voahanginirina Randriamboavonjy; Amro Elgheznawy; Alexander Mann; Ingrid Fleming
err分享
err收藏
Coherent controlization using superconducting qubits
err2015-12-15
err30
errOAAI
errFriis, Nicolai; Melnikov, Alexey A.; Kirchmair, Gerhard; Briegel, Hans J.
err分享
err收藏
Projective simulation with generalization
err2017-10-31
err30
errOAAI
errMelnikov, Alexey A.; Makmal, Adi; Dunjko, Vedran; Briegel, Hans J.
err分享
err收藏
err分享
err收藏
学者 查看更多内容