arrow
Return

Data-driven experimental design and model development using Gaussian process with active learning

delete2021-03-01
delete12
delete
OA
AI
常江芳 (Jorge Chang) *
J
Jiseob Kim
B
Byoung‐Tak Zhang
M
Mark A. Pitt
J
Jay I. Myung
DOI:10.1016/j.cogpsych.2020.101360delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Interest in computational modeling of cognition and behavior continues to grow. To be most productive, modelers should be equipped with tools that ensure optimal efficiency in data collection and in the integrity of inference about the phenomenon of interest. Traditionally, models in cognitive science have been parametric, which are particularly susceptible to model misspecification because their strong assumptions (e.g. parameterization, functional form) may introduce unjustified biases in data collection and inference. To address this issue, we propose a data-driven nonparametric framework for model development, one that also includes optimal experimental design as a goal. It combines Gaussian Processes, a stochastic process often used for regression and classification, with active learning, from machine learning, to iteratively fit the model and use it to optimize the design selection throughout the experiment. The approach, dubbed Gaussian process with active learning (GPAL), is an extension of the parametric, adaptive design optimization (ADO) framework (Cavagnaro, Myung, Pitt, & Kujala, 2010). We demonstrate the application and features of GPAL in a delay discounting task and compare its performance to ADO in two experiments. The results show that GPAL is a viable modeling framework that is noteworthy for its high sensitivity to individual differences, identifying novel patterns in the data that were missed by the model-constrained ADO. This investigation represents a first step towards the development of a data-driven cognitive modeling framework that serves as a middle ground between raw data, which can be difficult to interpret, and parametric models, which rely on strong assumptions.
Keywords:
Computational cognition
Data-driven cognitive modeling
Gaussian process
Active learning
Optimal experimental design
Delay discounting
Nonparametric Bayesian methods
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Cognitive Psychology cover
Cognitive Psychology
IF:
3
Papers:
990
Citations:
7.8K

Organization

U
University System of Ohio
Scholars:
15.4W
Papers: 13.0W
Citations: 200
O
Ohio State University
Scholars:
4.1W
Papers: 3.2W
Citations: 80
Cited Papers

Cited Papers

Temporal construal
err2003-01-01
err2.8K
PREAI
errTrope, Y; Liberman, N
errShare
errSave
Validity of the Nike+Device During Walking and Running
err2009-12-21
err0
PREAI
errN. A. Kane; M. C. Simmons; D. John; D. L. Thompson; D. R. Basset
errShare
errSave
errShare
errSave
errShare
errSave
Smokers with CT Detected Emphysema and No Airway Obstruction Have Decreased Plasma Levels of EGF, IL-15, IL-8 and IL-1ra
err2013-04-05
err0
errOAAI
errJuan P. de-Torres; David Blanco; Ana B. Alcaide; Luis M. Seijo; Gorka Bastarrika; María José Pajares; Arrate Muñoz-Barrutia; Carlos Ortiz-de-Solorzano; Ruben Pio; Arantza Campo; Usua Montes; Victor Segura; Jesús Pueyo; Luis M. Montuenga; Javier J. Zulueta
errShare
errSave
researcher View more