Return
Variable selection with neural networks
DOI:10.1016/0925-2312(95)00121-2.png)
Abstract
En 中文
In this paper, we present 3 different neural network-based methods to perform variable selection. OCD - Optimal Cell Damage - is a pruning method, which evaluates the usefulness of a variable and prunes the least useful ones (it is related to the Optimal Brain Damage method of Le Cun et al.). Regularization theory proposes to constrain estimators by adding a term to the cost function used to train a neural network. In the Bayesian framework, this additional term can be interpreted as the log prior to the weights distribution. We propose to use two priors (a Gaussian and a Gaussian mixture) and show that this regularization approach allows to select efficient subsets of variables. Our methods are compared to conventional statistical selection procedures and are shown to significantly improve on that.
Keywords:
variable selection
regularization
neural network pruning
dimensionality reduction
Journal
IF:
6.5
Papers:
2.5W
Citations:
6.5W
Organization
No organization information available
Cited Papers
Transition Management for Sustainable Development: A Prescriptive, Complexity‐Based Governance Framework
Governance
IF0
Dietary trans and saturated fatty acids effects on semen quality, hormonal levels and expression of genes related to steroid metabolism in mouse adipose tissue
Andrologia
IF0

