arrow
Return

Variable selection with neural networks

delete1996-07-01
delete61
PRE
AI
T
Tautvydas Cibas
F
Françoise Fogelman Soulié
P
Patrick Gallinari
Š
Šarūnas Raudys
DOI:10.1016/0925-2312(95)00121-2delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, we present 3 different neural network-based methods to perform variable selection. OCD - Optimal Cell Damage - is a pruning method, which evaluates the usefulness of a variable and prunes the least useful ones (it is related to the Optimal Brain Damage method of Le Cun et al.). Regularization theory proposes to constrain estimators by adding a term to the cost function used to train a neural network. In the Bayesian framework, this additional term can be interpreted as the log prior to the weights distribution. We propose to use two priors (a Gaussian and a Gaussian mixture) and show that this regularization approach allows to select efficient subsets of variables. Our methods are compared to conventional statistical selection procedures and are shown to significantly improve on that.
Keywords:
variable selection
regularization
neural network pruning
dimensionality reduction

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

No organization information available
Cited Papers

Cited Papers

Chronic Pain and the Emotional Brain: Specific Brain Activity Associated with Spontaneous Fluctuations of Intensity of Chronic Back Pain
err2006-11-22
err0
errOAAI
errMarwan N. Baliki; Dante R. Chialvo; Paul Y. Geha; Robert M. Levy; R. Norman Harden; Todd B. Parrish; A. Vania Apkarian
errShare
errSave
Arsenic Removal from Natural Water Using Low Cost Granulated Adsorbents: A Review
err2014-05-30
err0
errOAAI
errShams Ali Baig; Tiantian Sheng; Yunjun Hu; Jiang Xu; Xinhua Xu
errShare
errSave
Relative alpha desynchronization and synchronization during speech perception
err1997-06-01
err0
PREAI
errChristina M Krause; Bodil Pörn; A.Heikki Lang; Matti Laine
errShare
errSave
errShare
errSave
Dietary trans and saturated fatty acids effects on semen quality, hormonal levels and expression of genes related to steroid metabolism in mouse adipose tissue
err2019-03-15
err0
errOAAI
errSolmaz Molaie; Abdolhossein Shahverdi; Mohsen Sharafi; Maryam Shahhoseini; Leila Rashki Ghaleno; Vahid Esmaeili; Elham Abed‐Heydari; Mustafa Numan Bucak; AliReza Alizadeh
errShare
errSave
Investigation of SiGe-heterostructure nanowires
err2001-05-25
err0
PREAI
errE Giovine; A Notargiacomo; L Di Gaspare; E Palange; F Evangelisti; R Leoni; G Castellano; G Torrioli; V Foglietti
errShare
errSave
researcher View more