arrow
返回

Model-based reinforcement learning: a computational model and an fMRI study

delete2005-01-01
delete12
PRE
AI
W
Wako Yoshida
S
Shin Ishii
DOI:10.1016/j.neucom.2004.04.012delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this paper, we discuss an optimal decision-making problem in an unknown environment on the bases of both machine learning and brain learning. We present a model-based reinforcement learning (RL) in which the environment is directly estimated. Our RL performs action selection according to the detection of environmental changes and the current value function. In a partially-observable situation, in which the environment includes unobservable state variables, our RL incorporates estimation of unobservable variables. We propose a possible functional model of our RL, focusing on the prefrontal cortex and the anterior cingulate cortex. To test the model, we conducted a human imaging study during a sequential learning task, and found significant activations in the dorsolateral prefrontal cortex and the anterior cingulate cortex during RL. From a comparison of the mean activations in the earlier and later learning phases, we suggest that the dorsolateral prefrontal cortex maintains and manipulates the environmental model, while the anterior cingulate cortex is related to the uncertainty of action selection. These experimental results are consistent with our model. (C) 2004 Elsevier B.V. All rights reserved.
Keyword:
reinforcement learning
partially-observable Markov decision process (POMDP)
prefrontal cortex
functional MRI
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

暂无机构信息
引用论文

引用论文

err
IF0
err
err0
PREAI
err
err分享
err收藏
Temporal dynamics of brain activation during a working memory task
errNATURE
IF48.5
err1997-04-01
err1.6K
errOAAI
errCohen, JD; Perlstein, WM; Braver, TS; Nystrom, LE; Noll, DC; Jonides, J; Smith, EE
err分享
err收藏
Blind Compressed Sensing
err2011-10-01
err0
errOAAI
errSivan Gleichman; Yonina C. Eldar
err分享
err收藏
Facebook addiction and loneliness in the post-graduate students of a university in southern India
err2017-05-15
err0
PREAI
errManoj Shettar; Ravichandra Karkal; Anil Kakunje; Rohan Dilip Mendonsa; VV Mohan Chandran
err分享
err收藏
The prefrontal cortex: Response selection or maintenance within working memory?
errSCIENCE
IF45.8
err2000-06-02
err785
PREAI
errRowe, JB; Toni, I; Josephs, O; Frackowiak, RSJ; Passingham, RE
err分享
err收藏
A neural substrate of prediction and reward预测和奖励的神经基础
errSCIENCE
IF45.8
err1997-03-14
err7.0K
errOAAI
errSchultz, W; Dayan, P; Montague, PR
err分享
err收藏
err分享
err收藏
学者 查看更多内容