arrow
Return

A reinforcement learning diffusion decision model for value-based decisions

delete2019-03-28
delete101
delete
OA
AI
L
Laura Fontanesi *
S
Sebastian Gluth
M
Mikhail S. Spektor
J
Jörg Rieskamp
DOI:10.3758/s13423-018-1554-2delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Psychological models of value-based decision-making describe how subjective values are formed and mapped to single choices. Recently, additional efforts have been made to describe the temporal dynamics of these processes by adopting sequential sampling models from the perceptual decision-making tradition, such as the diffusion decision model (DDM). These models, when applied to value-based decision-making, allow mapping of subjective values not only to choices but also to response times. However, very few attempts have been made to adapt these models to situations in which decisions are followed by rewards, thereby producing learning effects. In this study, we propose a new combined reinforcement learning diffusion decision model (RLDDM) and test it on a learning task in which pairs of options differ with respect to both value difference and overall value. We found that participants became more accurate and faster with learning, responded faster and more accurately when options had more dissimilar values, and decided faster when confronted with more attractive (i.e., overall more valuable) pairs of options. We demonstrate that the suggested RLDDM can accommodate these effects and does so better than previously proposed models. To gain a better understanding of the model dynamics, we also compare it to standard DDMs and reinforcement learning models. Our work is a step forward towards bridging the gap between two traditions of decision-making research.
Keywords:
Decision-making
Computational modeling
Bayesian inference and parameter estimation
Response time models
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

P
Psychonomic Bulletin and Review
IF:
3
Papers:
4.5K
Citations:
1.5W

Organization

U
University of Basel
Scholars:
3.1W
Papers: 2.4W
Citations: 38