arrow
Return

USING MODEL SELECTION ALGORITHMS TO OBTAIN RELIABLE COEFFICIENT ESTIMATES

delete2011-09-05
delete13
PRE
AI
J
Jennifer L. Castle *
W
W. Robert Reed
DOI:10.1111/j.1467-6419.2011.00704.xdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This review surveys a number of common model selection algorithms (MSAs), discusses how they relate to each other and identifies factors that explain their relative performances. At the heart of MSA performance is the trade-off between type I and type II errors. Some relevant variables will be mistakenly excluded, and some irrelevant variables will be retained by chance. A successful MSA will find the optimal trade-off between the two types of errors for a given data environment. Whether a given MSA will be successful in a given environment depends on the relative costs of these two types of errors. We use Monte Carlo experimentation to illustrate these issues. We confirm that no MSA does best in all circumstances. Even the worst MSA in terms of overall performance the strategy of including all candidate variables sometimes performs best (viz., when all candidate variables are relevant). We also show how (1) the ratio of relevant to total candidate variables and (2) data-generating process noise affect relative MSA performance. Finally, we discuss a number of issues complicating the task of MSAs in producing reliable coefficient estimates.
Keywords:
AIC
AICc
Autometrics
Bayesian model averaging
General-to-specific modelling
Information criteria
Model selection algorithms
Monte Carlo analysis
Portfolio models
SIC
SICc
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Journal of Economic Surveys cover
Journal of Economic Surveys
IF:
5
Papers:
1.2K
Citations:
5.9K

Organization

University of Colorado System cover
University of Colorado System
Scholars:
6.3W
Papers: 5.5W
Citations: 1.8K
U
university of colorado boulder
Scholars:
1.9W
Papers: 1.5W
Citations: 33
U
university of oxford
Scholars:
9.7W
Papers: 8.6W
Citations: 137
researcher View more organizations