arrow
返回

Normative decision rules in changing environments

delete2022-10-25
delete2
delete
OA
AI
N
Nicholas W. Barendregt *
J
Joshua I. Gold
K
Krešimir Josić́
Z
Zachary P. Kilpatrick
DOI:10.7554/eLife.79824delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Models based on normative principles have played a major role in our understanding of how the brain forms decisions. However, these models have typically been derived for simple, stable conditions, and their relevance to decisions formed under more naturalistic, dynamic condi-tions is unclear. We previously derived a normative decision model in which evidence accumulation is adapted to fluctuations in the evidence-generating process that occur during a single decision (Glaze et al., 2015), but the evolution of commitment rules (e.g. thresholds on the accumulated evidence) under dynamic conditions is not fully understood. Here, we derive a normative model for decisions based on changing contexts, which we define as changes in evidence quality or reward, over the course of a single decision. In these cases, performance (reward rate) is maximized using decision thresholds that respond to and even anticipate these changes, in contrast to the static thresholds used in many decision models. We show that these adaptive thresholds exhibit several distinct temporal motifs that depend on the specific predicted and experienced context changes and that adaptive models perform robustly even when implemented imperfectly (noisily). We further show that decision models with adaptive thresholds outperform those with constant or urgency-gated thresholds in accounting for human response times on a task with time-varying evidence quality and average reward. These results further link normative and neural decision-making while expanding our view of both as dynamic, adaptive processes that update and use expectations to govern both deliberation and commitment.
Keyword:
decision-making
normative modeling
dynamic programming
None

期刊

eLife 封面图
eLife
IF:
0
论文数:
1.8W
被引数:
16

机构

University of Colorado System 封面图
University of Colorado System
学者数:
6.3W
论文数: 5.5W
被引数: 1.8K
U
university of pennsylvania
学者数:
9.2W
论文数: 7.8W
被引数: 153
U
university of colorado boulder
学者数:
2.0W
论文数: 1.5W
被引数: 33
学者 查看更多机构
引用论文

引用论文

Occurrence of D-amino acids in food
err1989-01-01
err0
PREAI
errGerardo Palla; Rosangela Marchelli; Arnaldo Dossena; Giuseppe Casnati
err分享
err收藏
Overcoming Indecision by Changing the Decision Boundary
err2017-06-01
err36
errOAAI
errMalhotra, Gaurav; Leslie, David S.; Ludwig, Casimir J. H.; Bogacz, Rafal
err分享
err收藏
Osteoid Osteoma of the Spine Treated With Percutaneous Computed Tomography–Guided Thermocoagulation
err2000-05-01
err0
PREAI
errJos A. Cové; Antonie H. Taminiau; Willem R. Obermann; Geert M. Vanderschueren
err分享
err收藏
Stochastic Models of Evidence Accumulation in Changing Environments
err2016-01-01
err36
errOAAI
errVeliz-Cuba, Alan; Kilpatrick, Zachary P.; Josic, Kresimir
err分享
err收藏
err分享
err收藏
CCM.G-K2 key comparison
err2015-04-20
err0
errOAAI
errOlivier Francis; Henri Baumann; Christian Ullrich; Stefaan Castelein; Michel Van Camp; Mauro Andrade de Sousa; Rodrigo Lima Melhorato; Chunjian Li; Jinyi Xu; Duowu Su; Shuqing Wu; Hua Hu; Kang Wu; Gang Li; Zhe Li; Wen-Chi Hsieh; Pecný Vojtech Ṕlinḱs; Jakub Kostelecký; Jaakko Mäkinen; Jyri Näränen; Sébastien Merlet; Franck Pereira Dos Santos; Pierre Gillot; Jacques Hinderer; Jean-Daniel Bernard; Nicolas Le Moigne; Benjamin Fores; Olga Gitlein; Manuel Schilling; Reinhard Falk; Herbert Wilmes; Alessandro Germak; Emanuele Biolcati; Claudio Origlia; Domenico Iacovone; Francesco Baccaro; Shigeki Mizushima; Raphaël De Plaen; Gilbert Klein; Marc Seil; Remi Radinovic; Marcin Sekowski; Przemyslaw Dykowski; In-Mook Choi; Min-Seok Kim; Ana Borreguero; Sergio Sainz-Maza; Marta Calvo; Andreas Engfeldt; Jonas Agren; René Reudink; Mark Eckl; Derek van Westrum; Ryan Billson; Brian Ellis
err分享
err收藏
Normative evidence accumulation in unpredictable environments
err2015-08-31
err108
errOAAI
errGlaze, Christopher M.; Kable, Joseph W.; Gold, Joshua I.
err分享
err收藏
学者 查看更多内容