Model Flexibility Analysis

doi:10.1037/a0039657

Model Flexibility Analysis

2015-10-01

20

OA

AI

V

Vladislav D. Veksler *

DOI：10.1037/a0039657

原文求助

摘要

En 中文

A good fit of model predictions to empirical data are often used as an argument for model validity. However, if the model is flexible enough to fit a large proportion of potential empirical outcomes, finding a good fit becomes less meaningful. We propose a method for estimating the proportion of potential empirical outcomes that the model can fit: Model Flexibility Analysis (MFA). MFA aids model evaluation by providing a metric for gauging the persuasiveness of a given fit. We demonstrate that MFA can be more informative than merely discounting the fit by the number of free parameters in the model, and show how the number of free parameters does not necessarily correlate with the flexibility of the model. Additionally, we contrast MFA with other flexibility assessment techniques, including Parameter Space Partitioning, Model Mimicry, Minimum Description Length, and Prior Predictive Evaluation. Finally, we provide examples of how MFA can help to inform modeling results and discuss a variety of issues relating to the use of MFA in model validation.

Keyword:

model evaluation

model selection

goodness of fit

model flexibility

parametric complexity

Model Flexibility Analysis

摘要

期刊

机构

引用论文