.png){kind=icon}
返回
Intelligent problem-solving as integrated hierarchical reinforcement learning
.png){kind=icon}
PRE
AI
DOI：10.1038/s42256-021-00433-9.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Although artificial reinforcement learning agents do well when rules are rigid, such as games, they fare poorly in real-world scenarios where small changes in the environment or the required actions can impair performance. The authors provide an overview of the cognitive foundations of hierarchical problem-solving, and propose steps to integrate biologically inspired hierarchical mechanisms to enable problem-solving skills in artificial agents. According to cognitive psychology and related disciplines, the development of complex problem-solving behaviour in biological agents depends on hierarchical cognitive mechanisms. Hierarchical reinforcement learning is a promising computational approach that may eventually yield comparable problem-solving behaviour in artificial agents and robots. However, so far, the problem-solving abilities of many human and non-human animals are clearly superior to those of artificial systems. Here we propose steps to integrate biologically inspired hierarchical mechanisms to enable advanced problem-solving skills in artificial agents. We first review the literature in cognitive psychology to highlight the importance of compositional abstraction and predictive processing. Then we relate the gained insights with contemporary hierarchical reinforcement learning methods. Interestingly, our results suggest that all identified cognitive mechanisms have been implemented individually in isolated computational architectures, raising the question of why there exists no single unifying architecture that integrates them. As our final contribution, we address this question by providing an integrative perspective on the computational challenges to develop such a unifying architecture. We expect our results to guide the development of more sophisticated cognitively inspired hierarchical machine learning architectures.
Keyword:
INTRINSIC MOTIVATION
MENTAL SIMULATION
FRAMEWORK
BRAIN
ABSTRACTION
UNCERTAINTY
PERCEPTION
CURIOSITY
BEHAVIOR
期刊
IF:
23.9
论文数:
1.3K
被引数:
1.5W
机构
引用论文
An extreme flood caused by a heavy snowfall over the Indigirka River basin in Northeastern Siberia
PREAI
分享收藏
Hierarchical reinforcement learning via dynamic subspace search for multi-agent planning基于动态子空间搜索的分层强化学习在多智能体规划中的应用.png)
AUTONOMOUS ROBOTS
AUTONOMOUS ROBOTSIF4.3
PREAI
分享收藏
查看更多内容