.png){kind=icon}
.png){kind=icon}
Return
Believing in dopamine
.png){kind=icon}
OA
AI
DOI：10.1038/s41583-019-0220-7.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Midbrain dopamine signals are widely thought to report reward prediction errors that drive learning in the basal ganglia. However, dopamine has also been implicated in various probabilistic computations, such as encoding uncertainty and controlling exploration. Here, we show how these different facets of dopamine signalling can be brought together under a common reinforcement learning framework. The key idea is that multiple sources of uncertainty impinge on reinforcement learning computations: uncertainty about the state of the environment, the parameters of the value function and the optimal action policy. Each of these sources plays a distinct role in the prefrontal cortex-basal ganglia circuit for reinforcement learning and is ultimately reflected in dopamine activity. The view that dopamine plays a central role in the encoding and updating of beliefs brings the classical prediction error theory into alignment with more recent theories of Bayesian reinforcement learning.
Keywords:
REWARD-PREDICTION ERRORS
DECISION-MAKING
NEURAL MECHANISMS
ORBITOFRONTAL CORTEX
PREFRONTAL CORTEX
LATENT INHIBITION
STRIATAL NEURONS
INFERENCE
RESPONSES
CONTEXT
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.