arrow
返回

Designing optimal behavioral experiments using machine learning

delete2024-01-23
delete1
delete
OA
AI
S
Simon Valentin *
S
Steven Kleinegesse
N
Neil R Bramley
P
Peggy Seriès
M
Michael U. Gutmann
C
Christopher G. Lucas
DOI:10.7554/eLife.86224delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Computational models are powerful tools for understanding human cognition and behavior. They let us express our theories clearly and precisely and offer predictions that can be subtle and often counter-intuitive. However, this same richness and ability to surprise means our scientific intuitions and traditional tools are ill-suited to designing experiments to test and compare these models. To avoid these pitfalls and realize the full potential of computational modeling, we require tools to design experiments that provide clear answers about what models explain human behavior and the auxiliary assumptions those models must make. Bayesian optimal experimental design (BOED) formalizes the search for optimal experimental designs by identifying experiments that are expected to yield informative data. In this work, we provide a tutorial on leveraging recent advances in BOED and machine learning to find optimal experiments for any kind of model that we can simulate data from, and show how by-products of this procedure allow for quick and straightforward evaluation of models and their parameters against real experimental data. As a case study, we consider theories of how people balance exploration and exploitation in multi-armed bandit decision-making tasks. We validate the presented approach using simulations and a real-world experiment. As compared to experimental designs commonly used in the literature, we show that our optimal designs more efficiently determine which of a set of models best account for individual human behavior, and more efficiently characterize behavior given a preferred model. At the same time, formalizing a scientific question such that it can be adequately addressed with BOED can be challenging and we discuss several potential caveats and pitfalls that practitioners should be aware of. We provide code to replicate all analyses as well as tutorial notebooks and pointers to adapt the methodology to different experimental settings.
Keyword:
experimental design
machine learning
computational modeling
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

eLife 封面图
eLife
IF:
0
论文数:
1.8W
被引数:
16

机构

U
University of Edinburgh
学者数:
5.2W
论文数: 4.6W
被引数: 71
引用论文

引用论文

Oxidation–adsorption of arsenite contaminated water over ceria nanorods
err2020-10-01
err0
PREAI
errSuttikorn Suwannatrai; Dickson Y.S. Yan; Jakkapop Phanthasri; Pummarin Khamdahsag; Suttipong Wannapaiboon; Visanu Tanboonchuy
err分享
err收藏
Contextual sensitivity in scientific reproducibility
err2016-05-23
err290
errOAAI
errVan Bavel, Jay J.; Mende-Siedlecki, Peter; Brady, William J.; Reinero, Diego A.
err分享
err收藏
When a good fit can be bad
err2002-10-01
err337
PREAI
errPitt, MA; Myung, IJ
err分享
err收藏
A reflective display based on the electro-microfluidic assembly of particles within suppressed water-in-oil droplet array
err2023-12-05
err0
errOAAI
errShitao Shen; Haoqiang Feng; Yueming Deng; Shuting Xie; Zichuan Yi; Mingliang Jin; Guofu Zhou; Paul Mulvaney; Lingling Shui
err分享
err收藏
Competing Theories of Multialternative, Multiattribute Preferential Choice
err2018-04-01
err85
errOAAI
errTurner, Brandon M.; Schley, Dan R.; Muller, Carly; Tsetsos, Konstantinos
err分享
err收藏
学者 查看更多内容